v0.2.0
What's Changed
Improvements
- Upgrade the weaviate provider to
apache-airflow-providers-weaviate==1.3.0
and use all upstream operators and hook methods for ingestion in airflow DAGs. #246 - Change user prompt rewording, add hybrid search, Cohere Reranker and LLM Chain Filter to document retrieval. #247
- Add Astro CLI ingestion to the weaviate database. #200
- Extract all GH issues with the date and time filter for ingestion. #182, #229
- Ingest Astronomer-provider and Astro-SDK HTML documentation to weaviate database. Ingestion of Astro SDK documentation is disabled in production. #199
- Ingest Stackoverflow using their API. #181
- Ingest Astro forum documentation. #212
- Use
sanic-limiter
to throttle Ask-Astro API based on IP address. #235 - Use astronomer documentation from the webpage (https://docs.astronomer.io/) instead of from the Github repository. #238
- Send Slack alerts for DAG failures. #249
- Add metric tracking: track
request-id
,score
,success
andcreated_at
metrics in Snowflake. 239 - Clean and consolidate the logic for the HTML extractor for the airflow ingestion DAGs. #237
Bug fixes
- Add retry logic for answering questions in Ask Astro. #180
- Refactor
extract_astro_blogs
to fetch all astronomer blogs. #176 - Fix h1 text alignment in Ask Astro UI. #219
- Return the source documents in the same order for the Slack bot as per the response in the UI. #256
- Update monitoring DAG to monitor all the ingestion DAGs. #225
- Improve the readability of answers in Ask Astro results which are in list format. #240
- Add retry in the feedback DAGs. #183
Documentation
- Improve the structure and readability of the documents. #162
- Add documentation to deploy airflow DAGs locally. #201
- Remove ingestion of data from Slack from README. #214
Misc
- Add test automation script for Ask-Astro to automate and ease testing and evaluation of the model responses. #210
- Setup ruff as part of pre-commit hooks. #175, #207
- Bump cryptography from 41.0.5 to 41.0.6. #218
- Bump vite from 4.4.9 to 4.4.12. #217
- Add
sanic_limiter
lock in poetry. #233
Full Changelog: v0.1.0...v0.2.0