Data Quality Detective Python CLI tool automates initial CSV and Excel checks

·3 views

A developer has created a Python command-line tool called Data Quality Detective (dqdetect) to automate initial data quality checks. The tool profiles CSV or Excel files to flag issues like missing values, duplicate rows, and outliers for further analyst review. It generates terminal summaries alongside Markdown and HTML reports. The first public version is available for installation via PyPI. The developer intends to keep the tool lightweight and focused on the preliminary inspection stage of data analysis.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Developer proposes environment fingerprinting to debug test failures across machines

A developer outlines a method to diagnose inconsistent test results between local and remote systems. The proposal emphasizes capturing system locale and encoding settings before theorizing causes. Discrepancies in default text encoding, like ASCII versus UTF-8, are identified as potential failure sources. The plan involves running a diagnostic script on both environments to generate comparable data. This data-driven approach aims to prevent premature conclusions based on local conditions alone.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Footagent developer seeks Android testers ahead of game launch

The developer of Footagent, a free 3D football runner, is recruiting Android testers. This is required by Google Play's policy for new developer accounts before a public launch. The mobile game features one-finger swipe controls to maneuver a player through 31 different career worlds. Testers are asked to provide feedback on gameplay and technical performance and can share their own projects for reciprocal testing.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Cloudflare introduces field for WAF detection failures, allows custom rule responses

Cloudflare has introduced a new field, cf.appsec.request.failed_detections, that reports when a security detector fails to complete its analysis. This field provides detection IDs but does not automatically change request outcomes or detector behavior. Administrators can now create rules to explicitly handle these failures, choosing actions like blocking, challenging, or allowing the request. The field covers failures from multiple detection systems including content scanning, WAF scoring, and AI prompt analysis. It is available across all Cloudflare plans and can be used in custom rules, rate limiting rules, and request-header rules.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

EU fines Alphabet $1.2 billion for anti-competitive AI search bundling

The European Union's Competition Commission fined Alphabet $1.2 billion on Tuesday. The ruling states the company abused its market dominance by bundling its AI search features, called 'AI Overviews,' with standard Google Search results. The EU determined this practice stifled competition from rivals like Bing and restricted consumer choice. Alphabet has announced it will appeal the decision.

0 comments Read more at DEV Community