Create Chatbot with website data

[balvirsingh]

Hi team,

My requirement is to create chatbot which use the website's data either directly crawl to answer or fetch data from website and store in a document. But in case of storing data to data store it should fetch the data from website every week. Kind of cron job I want to set.

Also, it should crawl all the paths of website and fetch complete text of website and remove html code.

Please Please Please suggest.