Contextual search tool with .txt document/query embedding for similarity comparison and document selection + summarization
Code utilizes PySpark framework and locally mounted directory
Workflow:
- Execute Doc_ingestion.py to ingest documents and collect text
- Execute BART_transformers_doc_embedding.py to embed documents
- Execute BART_transformers_query_embedding to embed manually defined query
- Complete with similarity assessment with Doc_query_similarity_assessment.py