When you need to bring your data into a search system, you can do this in a variety of ways. One way is to crawl your data. This video explains the difference between a crawler and a spider. Find out more Open Stack.