VirgoFash: A Zero-Dependency Async Python Library for Search and RAG Pipelines

·8 views

Developer Abdullah Jahangir has released VirgoFash, a lightweight, asynchronous search and retrieval-augmented generation (RAG) engine written in pure Python. The library was created to address the common trade-off between heavy scraping frameworks and brittle custom HTTP code in AI application development. VirgoFash relies only on asyncio and httpx, avoiding dependencies like Selenium or Playwright, which keeps environments lean and install times fast. It features deterministic relevance scoring for consistent pipeline behavior and is designed to integrate easily with async backends such as FastAPI. The library is available on PyPI and GitHub, and can be combined with Anthropic's Claude API to build AI-powered search assistants with minimal code.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

WClickHouse Library Loads 100,000-Row Pandas DataFrames into ClickHouse in Under 0.6s

A Python library called WClickHouse has introduced an insert_dataframe() method designed to load Pandas DataFrames into ClickHouse analytical databases at near-network speed, eliminating the need for slow row-by-row iteration. The tool addresses common pain points for data scientists, including type incompatibilities between Pandas float64/NaN values and ClickHouse's nullable types, as well as Jupyter Notebook crashes when exporting large datasets. According to the developers, the method can ingest 100,000 rows in under 0.6 seconds using a vectorized backend built on Apache Arrow and Pydantic v2. The library supports Python versions 3.9 through 3.14 and claims over 95% test coverage against real ClickHouse instances. WClickHouse is available on both GitHub and PyPI as an open-source project.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

WClickHouse Library Inserts 100K Pandas Rows into ClickHouse in Under 0.6 Seconds

An open-source Python library called WClickHouse offers a method called insert_dataframe() that loads Pandas DataFrames directly into ClickHouse databases using a vectorized backend. The tool addresses common pain points for data scientists, including slow row-by-row insertion methods like df.iterrows() that can take up to 20 minutes and type mismatches between Pandas and ClickHouse data types. The library automatically aligns Pandas dtypes with ClickHouse table schemas, eliminating manual conversion steps. It supports Python versions 3.9 through 3.14 and is built on Apache Arrow and Pydantic v2, with over 95% test coverage verified against live ClickHouse servers. WClickHouse is available on both GitHub and PyPI as part of an ongoing open-source engineering series.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

wFabricSecurity Brings Cryptographic Microsegmentation to Blockchain Nodes

An open-source tool called wFabricSecurity introduces cryptographic microsegmentation for Hyperledger Fabric blockchain networks, enforcing explicit communication permissions between nodes. The library applies a default-deny policy, meaning all inter-node communication is blocked unless specifically authorized. Permissions are managed through a Common Name (CN) based matrix, supporting both unidirectional and bidirectional communication rules. The tool is designed to prevent threats such as unauthorized lateral movement and compromised worker nodes issuing malicious commands to orchestrators. Compatible with Python 3.10 and above, it also includes code integrity hashing and token-bucket rate limiting.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

wFabricSecurity enforces cryptographic micro-segmentation for blockchain nodes

An open-source library called wFabricSecurity introduces cryptographic micro-segmentation to control communication between blockchain nodes in Hyperledger Fabric environments. The tool operates on a default-deny policy, meaning all inter-node communication is blocked unless explicitly permitted by the administrator. Permissions are registered using cryptographic Common Names, and the system supports both unidirectional and bidirectional communication rules. This approach addresses risks such as unauthorized lateral movement and compromised nodes sending malicious commands to orchestrators. The library is compatible with Python 3.10 and above, and is available on both GitHub and PyPI.

0 comments Read more at DEV Community