SShortSingh.
0
ProgrammingDEV Community ·

How Byte Pair Encoding Builds the Token Vocabulary Behind Language Models

Before a language model processes text, a tokenizer splits it into integer IDs drawn from a fixed vocabulary, and the model never directly sees letters or whole words. Byte pair encoding builds that vocabulary by starting from single characters and repeatedly merging the most frequent adjacent pair until a target size is reached. The article notes that vocabulary size is a tradeoff: larger vocabularies pack text into fewer tokens but add parameters, and because the vocabulary is learned from data, languages like Urdu end up costing far more tokens than English. The method originated as a 1994 data compression technique and was adapted for neural machine translation in 2016 by Sennrich, Haddow, and Birch to handle rare words. The authors implemented the algorithm from scratch on the paper's example dictionary to demonstrate how frequent words become single tokens while rarer ones split into pieces.

0
ProgrammingDEV Community ·

Darwin-180B-RSI-R3 Ranks Second on SuperCLUE Math and Science Reasoning Test

VIDRAFT, a South Korean AI startup, released Darwin-180B-RSI-R3, a 180-billion-parameter Mixture-of-Experts model built on Alibaba's Qwen3.8-Flash-Next. Independent evaluation by SuperCLUE on November 5, 2026 placed it second overall and first among open-weight models in math and science reasoning, with a score of 73.68. The model was produced by retraining only the attention, linear-attention, and shared expert layers while keeping the feed-forward expert blocks that store factual knowledge intact. Its weights are available under a Qwen community license permitting commercial use, and a 4-bit quantized edge variant can run on a 32 GB RAM laptop without a GPU. The reported gain over its base model in math and science reasoning was 15.8 points.

0
IndiaTimes of India ·

Nvidia CEO Linked to Chinese Spy Scandal Through Whiskey Dates and Deal Talks

A report by the Times of India examines how Nvidia's chief executive became entangled in a Chinese espionage controversy. The story centers on social encounters, including whiskey-related meetings, alongside discussions tied to billion-dollar business deals. Details of the alleged connection to Chinese intelligence activity are highlighted as the core of the scandal. The article frames the episode as a case of how commercial relationships can intersect with national security concerns. Specific allegations and responses from the parties involved are central to the reporting.

0
ProgrammingDEV Community ·

Engineer outlines a step-by-step method for planning AWS infrastructure tasks

A DevOps lead with about 15 years of infrastructure experience describes how a vague ticket to deploy a web service on AWS can hide many small steps. He explains that engineers first gather project context, current infrastructure details, and product knowledge before planning. The work is then split into stages such as writing infrastructure code, building workflows, creating AWS resources, deploying the app, and verifying it, with attention to their dependencies. Each stage breaks down into simple actions, guided by team conventions and past experience. He presents this as a way to turn a one-line ticket into a clear, checkable plan with actions, verification steps, and rollback.

0
ProgrammingDEV Community ·

Win32 app isolation requires per-app capability budgets, not a single on/off switch

Microsoft's Win32 app isolation adds a sandbox to classic Windows desktop applications, available in Windows 11 version 24H2 and later. Its protective value depends on which capabilities an app is granted and which resources it can reach, rather than the feature simply being enabled. The application capability profiler's learn mode can suggest a permission set, but its output is a proposal for testing and not a production-ready configuration. Each granted capability should be justified by the app's actual function, since consent prompts alone do not establish that broad access is appropriate. Teams should test real workflows such as updates, file access, and helper processes under standard and administrator accounts before rollout.

0
ProgrammingDEV Community ·

Developer releases 12 copy-paste AI blocks for static sites, no backend needed

A developer who runs several static sites built a gallery of twelve AI feature blocks that work without a server. The blocks, including page Q&A, summarization, translation, a FAQ bot, JSON extraction, and image alt text, are written in plain HTML and vanilla JavaScript of roughly 40 to 60 lines each. They call a public OneTag AI script from the browser, using a key that draws on a free allowance of 1,000,000 tokens obtained by signing up with an email address. The project is MIT-licensed, and the creator is inviting feedback on which blocks people would use and which are missing, with pull requests for new blocks welcome.

0
IndiaNDTV ·

Delhi Air Turns Severe After Diwali as Opposition Alleges Data Fraud and BJP Cites Past Inaction

A thick layer of smoke has settled over the Delhi-National Capital Region following Diwali celebrations. Visibility has dropped sharply, and air pollution has reached the 'severe' category at several monitoring locations. The opposition has alleged data fraud in connection with the pollution figures. The BJP has responded by blaming decades of inaction on the issue. The exchange of accusations comes as residents continue to face the hazardous air conditions.

0
ProgrammingDEV Community ·

Open hackathons this week: Meta VR challenge leads with $1M prize pool

A weekly roundup compiles open hackathons from Devpost, Unstop, Devfolio and MLH, ranked by prize money. The top listing is Meta's VR Start Developer Competition 2026, offering $1,000,000 with entries closing November 18. Several other online contests carry substantial pools, including Codegeist 2026 at $120,000 and Kiroween 2026 at $100,000. Smaller India-focused events, such as the Goa Buildathon 27 and INDIA GOT SPOT 1.0, are also listed with rupee-denominated prizes. The article's author also promotes a self-built scraper that reportedly identified 255 open hackathons this week.

0
ProgrammingDEV Community ·

RayStack 1.3.0 Adds dev-refactor Skill to Clean Up Codebases for AI Agents

A DEV Community post argues that AI coding agents perform only as well as the codebases they work in, since they lack the implicit knowledge human developers build up over time. Duplicated logic, undocumented call orders, and untested modules can cause an agent to make partial or incorrect fixes that still pass tests. The author notes that messy code also raises the context an agent must hold, making changes more costly and error-prone. To address this, RayStack 1.3.0 introduces a dev-refactor skill that restructures a repo or selected folder without altering its behavior. The process begins with a scope choice and a test baseline, adds characterization tests for untested code, and logs identified problems before any redesign is applied.

0
ProgrammingDEV Community ·

Building Trustworthy LLM-as-a-Judge Graders Requires Calibrated Rubrics

An LLM judge is only reliable when it has been calibrated against human labels, since otherwise it produces a consistent number that poorly reflects real quality. The article argues that the rubric, not the judge prompt, does the real work, and recommends writing concrete, checkable conditions instead of vague adjectives. It identifies three common problems: position bias in pairwise comparisons, a preference for verbose answers, and lenient grading when a model evaluates its own outputs. To counter these, it advocates placing hard-failure conditions first so clear errors are scored before any subjective interpretation. The piece closes with an example judge implementation built on the Anthropic API.

0
ProgrammingDEV Community ·

Warqa stamps each PDF and image with the downloader's email to trace leaks

Warqa, a contract management platform for Saudi companies, adds the downloader's email to every PDF and image at download time. The original file remains untouched in storage, and only a temporary stamped copy is sent. The stamp is a faint, repeated diagonal grid so it stays readable but is hard to crop out. Each copy also gets a unique tracking ID recorded in the file metadata and the activity log. If stamping fails, the error is reported and the file is still delivered without blocking the user.

0
ProgrammingDEV Community ·

How .NET Evolved from Framework to Core to a Unified Platform

The article traces the history of .NET, which Microsoft launched in 2002 with a Common Language Runtime that handled memory management and exception handling. The runtime was designed to host multiple languages, including C#, which became the flagship language. Visual Basic was also brought into the platform, though VB.NET was substantially redesigned from its predecessor and migrating older applications proved harder than expected. F# was later added as a functional-first language that still interoperates with C# and other .NET languages on the same underlying framework.

0
ScienceWIRED ·

How Jersey, a Self-Governing British Island, Became a Hub for Europe's Cannabis Trade

The small, self-governing British island of Jersey has unintentionally emerged as a key front line in Europe's multibillion-dollar global cannabis industry. The article examines how the island's unique legal and political status shaped this role. Its position as a self-governing Crown Dependency has drawn attention to its involvement in the wider cannabis market. The piece is based on a WIRED report and is limited to the information provided in the source's brief summary.

0
IndiaTimes of India ·

Kolkata doctor found dead in hostel room; family alleges murder

Abhijit Sarkar, a 28-year-old doctor, was found dead in his hostel room in Kolkata. His family believes he was murdered rather than having died by suicide. Before his death, Sarkar posted a WhatsApp status expressing distress about his situation. Police are investigating, examining his social media activity and phone records. The post-mortem report is expected to help establish how he died.

0
ProgrammingHacker News ·

Opinion Piece Argues Workers Acting as Human Proxies for AI Should Face Dismissal

A blog post on swiftrocks.com contends that employees who serve as human stand-ins for AI systems should be grounds for termination. The item was shared on Hacker News, where it gathered 10 points and one comment at the time of listing. The article's core argument centers on the practice of people passing along or vouching for AI-generated output in place of their own work. The source material provided is limited to a headline, URL, and engagement metrics, so the full reasoning and specific examples in the piece could not be verified here.

0
Crypto & Web3CoinDesk ·

SpaceX Proposes $24B Texas AI Supercomputer, About 17 Times Its Bitcoin Holdings

SpaceX has proposed a $24 billion project centered on an AI supercomputer in Texas. The facility would come with its own gas-fired power plant to supply its energy needs. The project's value is roughly 17 times that of the bitcoin SpaceX currently holds. The article frames the comparison as a way to show the scale of the proposed investment relative to the company's crypto assets.

0
IndiaTimes of India ·

Daler Mehndi's Haryana and Delhi properties under scrutiny over land disputes

Singer Daler Mehndi has been linked to substantial land holdings in Sohna, Haryana. His farmhouse near Damdama Lake reportedly faced action from local authorities over environmental violations. Separately, a 10-acre property was seized by the municipality in 2013 amid a wider land dispute. The Sohna Municipal Council said the move was part of a broader drive against unlawful land occupation.

0
IndiaNDTV ·

Kolkata Techie Killed in Attack; Live-In Partner and Her Mother Arrested

A techie in Kolkata was hacked to death, according to a report by NDTV. Police have arrested her live-in partner and the partner's mother in connection with the killing. Investigators are examining whether the attack arose solely from an altercation or whether other motives played a part. The available text provides limited detail beyond these points, so further facts about the timeline and circumstances remain unconfirmed. Authorities are continuing their inquiry into the case.

← NewerPage 419 of 7346Older →