Launched This Independence Day! — 15th August 2026
Celebrating India's Linguistic Diversity Through ML
Noise event detection and removal in real-world Indic speech โ be part of India's ML community. Build something meaningful for Bharat. ๐ฎ๐ณ
Open to everyone based in India โ students, researchers & industry professionals
Congratulations to the Top 8 teams on the Track 1 (Noise Event Detection) Phase 1 leaderboard. The leaderboard is NOT reset โ all teams continue into Phase 2.
| Rank | Team | Members (Affiliation) |
|---|---|---|
| ๐ฅ 1 | CodeAMU | Shah Ahmed Shakir Abu Asim Khan (AMU), Sajid Javid (IIIT Delhi), Osama Zaheer (Binary Semantics), Ahraz Shamim (Vecmocon Technologies) |
| ๐ฅ 2 | ARCLY INDIA | Umar Khan (Robonito), Mohammad Ashraf (TeleCRM), Md Mizan Ahmad (BEL), Zuhair Arif (AMU) |
| ๐ฅ 3 | Syehsyoh | Saifuddin ST |
| 4 | Hydra | Manish Joshi (Independent Researcher), Neeraj Singh Aithani (Independent Researcher) |
| 5 | TensorForge | Mohd Huzaifa (Jamia Millia Islamia), Eraf Ali (IIT Madras), Mohd Rashid (Sofyrus Technologies), Abdul Haseeb (TCS), Mohd Azhan Kamil (Cognizant) |
| 6 | Sonic Boom | Rohit Singhee (Walmart), Rounak Neogy (Walmart), Kalash Bhattad (Walmart), Ayush Malik (Walmart) |
| 7 | BumbleBee | Dipan Mandal (Research Assistant, IIT Delhi) |
| 8 | liyingfa | Yingfa Li (Capital Medical University), Pritam Bhakat (Jawaharlal Nehru University), Shuang Liang (Capital Medical University), Yu Gu (Capital Medical University) |
For Track 1 (Noise Event Detection), the Phase 2 test set is identical to the Phase 1 test set. Nothing has changed โ you do not need to download any new data, and your existing pipeline will continue to work as-is. Because the data is unchanged, there is no refresh/reset of the Track 1 leaderboard โ all Phase 1 scores carry over and remain directly comparable with Phase 2 submissions.
input_data [Final Submission (Phase 2)].
If your submission is failing, please make sure you are generating and submitting your files with respect to the NEW Phase 2 test data
(enhanced WAVs must match the new test clip filenames, and transcripts.jsonl must cover the new clips).
Track 1 test data for Phase 2 is unchanged โ no leaderboard reset.
To ensure the integrity and fairness of the Track 2 evaluation โ and in response to concerns raised regarding submissions โ we are introducing an additional verification audit as a precautionary measure. Track 2 participants are requested to provide their executable model inference code and required model files so that submitted models can be independently reproduced and verified by the organizers on the evaluation data.
Along with your final Phase 1 submission, please share a ZIP package containing:
requirements.txt, environment.yml, or an equivalent dependency specification.main.py script (or equivalent executable code) that runs inference. Please name the entry-point file main.py so the main file is easy to identify.You do NOT need to submit the SraVaani ASR model. It is simply a Hugging Face call (ARTPARK-IISc/SraVaani-1.0) โ you only need to provide the script that calls the Hugging Face model, and the audio is transcribed with the same ASR. This keeps the ZIP lightweight; only your enhancement model and inference code are required.
The inference script must take exactly two arguments:
After inference, the enhanced audio files must be saved in the output folder with the same file names as the input audio files, along with the JSON transcript file in the same format as the submission format specified on Codabench.
Naming (important): Name the ZIP file and its top-level folder as your Team_name
(e.g., Team_name.zip containing a Team_name/ folder). This lets us clearly identify multiple submissions and,
if a reproduction issue arises, revert each team individually.
Welcome to Datathon@IndoML 2026 - a research-oriented data science competition held in conjunction with IndoML 2026. Building on the success of previous editions, this year's datathon challenges participants to tackle noise event detection and removal in real-world Indic speech - a critical problem for inclusive, robust Automatic Speech Recognition across Indian languages.
The competition is organised into two tightly coupled tracks: Track 1 (Detection) - detect noise events with precise timestamps, effectively utilising data annotated at different levels - and Track 2 (Removal) - suppress detected events while preserving the underlying speech. The dataset is a curated subset of the Vaani corpus, consisting of ~154.6 hours of real-world Indic audio with three levels of annotation quality.
Top-performing teams will be invited to attend IndoML 2026 and present their solutions to leading researchers and professionals from academia and industry. These teams will also receive exciting cash prizes.
input_data. The validation dataset is available there for both tracks.predictions.jsonl file. Track 2: enhanced 16 kHz mono WAV files + transcripts.jsonl from the mandated ASR.The Top 8 teams for Track 1 (Noise Event Detection), Phase 1 have been announced: CodeAMU, ARCLY INDIA, Syehsyoh, Hydra, TensorForge, Sonic Boom, BumbleBee and liyingfa. The leaderboard is not reset โ all teams continue into Phase 2. Track 2 results will follow after model and inference code verification. See the full list โ
For Track 1, the Phase 2 test data is exactly the same as Phase 1. There is no new data to download, and because the dataset is unchanged the leaderboard is not refreshed/reset โ all Phase 1 scores carry over. The changed-test-data notice applies to Track 2 only. More details โ
Track 2 teams must submit their model + inference code package via the Track 2 material submission Google Form by 24th September 2026, 11:59 PM IST. This is 2 days after the Phase 1 deadline (22nd September, 12:00 Noon IST). Phase 1 ranks are decided by your Codabench leaderboard submission at the Phase 1 deadline; the Google Form package is used for verification/reproduction. See the full requirements at the top of this page โ
Phase 2 has begun. For Track 2, the test data has changed for Phase 2 โ download the new set from Codabench at Get Started โ Files โ input_data [Final Submission (Phase 2)]. If your submission is failing, ensure your enhanced WAVs and transcripts.jsonl are generated with respect to the new Phase 2 test data. Track 1 test data is unchanged and the leaderboard is not reset.
Track 2 code/model submission: submit your material (inference code, model files, README) via the Track 2 material submission Google Form โ See the full requirements at the top of this page โ
Due to Codabench downtime, both deadlines have been extended by 2 days for fairness: Phase 1 (Half-Marathon) from 20th to 22nd September 2026, and Phase 2 (Final) from 15th to 17th October 2026 โ both at 12:00 Noon IST. All other timelines remain unchanged. Thank you for your patience!
To ensure the integrity and fairness of the Track 2 evaluation, all Track 2 teams must submit their executable inference code (a main.py) and required model files along with their final Phase 1 submission, so that models can be independently reproduced and verified by the organizers. Name the ZIP as your Team_name and include the primary contact's mobile & email in the README. You do not need to submit the SraVaani ASR model โ it's just a Hugging Face call; simply include the script that calls it (audio is transcribed with the same ASR). See the full submission requirements at the top of this page โ
Our first Ask Me Anything (AMA) session was held on 9th September 2026, walking through the task, dataset, baselines and evaluation for both tracks, followed by a live Q&A. Registration is now closed.
The validation dataset is now available for both tracks in Codabench under Get Started โ Files. Use it to tune and benchmark your models before the final test phase.
The competition dataset is now released, and both tracks are live on Codabench for all phases. Submit your entries and climb the leaderboard: Track 1: Noise Event Detection โ | Track 2: Noise Event Removal โ
How to participate:
Metric note (Track 2): ΔWER is now reported as a percentage (e.g. −1.17) on the leaderboard to match the official ASR scoring convention. The ranking Combined score (SI-SDR + 100×ΔWERfraction) is unchanged.
Registration is live! Task description, dataset details, evaluation metrics, and data examples are now available. Registration is now closed (9th September 2026).
The official website for Datathon@IndoML 2026 is now live. Registration details, task description, dataset, and timeline will be announced soon.
Most academic speech enhancement benchmarks are built around stationary noise (white, pink, cafรฉ hum) or studio-recorded mixtures. Field recordings from rural and semi-urban India contain bursty, semantically rich events โ a passing motorbike, a hen, a pressure-cooker whistle, a doorbell, a TV in another room โ that current denoisers either smear over or treat as speech.
Two consequences follow:
This challenge targets that gap directly. It asks participants to treat noise as a first-class, labelled, time-localised object โ and then to suppress it without harming the speech.
Robust, Inclusive Speech Processing for Real-World Indic Speech
Speech recordings collected in real Indian environments are dominated by non-stationary background events - vehicle horns, dogs barking, children crying, doorbells, ringtones, kitchen appliances, and devotional music. These events degrade downstream Automatic Speech Recognition (ASR).
This challenge invites participants to build a two-stage system on the Vaani dataset that (i) detects noise events with precise timestamps, and (ii) removes them while preserving the underlying speech. The challenge is framed under the Responsible AI theme, with explicit emphasis on robustness, linguistic inclusivity across multiple Indian languages, and methodological transparency.
Participants may enter either track independently or both.
Detect noise events in Indic speech recordings with precise onset/offset timestamps. Effectively utilise data annotated at different levels.
{onset: 1.24, offset: 3.81},
{onset: 4.31, offset: 4.71},
{onset: 5.04, offset: 5.41}
Suppress the detected noise events while preserving the underlying speech signal - output clean, intelligible audio.
16 kHz mono WAV - one per test clip, original filename retained
Track 1: Submit a JSON file with onset/offset events per clip.
Track 2: Submit cleaned 16 kHz mono WAV files.
Automated scoring on held-out test clips. Track 1: F1 + Dice. Track 2: SI-SDR + ฮWER, then PESQ for top-5.
Live rankings published after each submission window. Final standings adjusted by expert Novelty Score for top-5 entries.
Top teams invited to present at IndoML 2026 and receive cash prizes. Code release required for prize-eligible entries.
A prediction is correct when its temporal extent overlaps with ground truth within +/-20% of event duration.
Temporal overlap between predicted and reference event segments: 2 * |P intersection G| / (|P|+|G|).
Scale-Invariant Signal-to-Distortion Ratio between enhanced signal and synthetic clean reference.
A frozen multilingual Indic ASR is run on both noisy and enhanced clips. Delta WER = WERnoisy - WERenhanced. Higher is better.
Perceptual Evaluation of Speech Quality - intelligibility & naturalness vs. clean references. Evaluated only for the top-5 initial entries.
This challenge is positioned under the Responsible AI track on three explicit axes:
Real-world Indic recordings - not curated studio mixtures - are the evaluation distribution. Systems are scored on actual ASR improvement (Delta WER), not signal-level metrics alone.
Vaani spans multiple Indian languages and a wide range of speakers. The eval set is monitored for language-wise and class-wise balance so no sub-population is under-represented.
Top-5 submissions must release code and document pre-trained dependencies. The frozen ASR used for Delta WER is publicly identified for independent reproducibility.
Register on the Codabench competition pages to make submissions, view the live leaderboards, and access the evaluation phase. Download the training dataset to get started.
Detect noise events (onset/offset timestamps) in real-world Indic speech. Submit a predictions.jsonl file.
Suppress detected noise events while preserving speech. Submit enhanced 16 kHz mono WAV files.
Open Track 2 on CodabenchThe Vaani Noise Event dataset with multi-tier (Gold / Silver / Bronze) annotations, hosted on Hugging Face.
Get the Dataset on Hugging FaceA large-scale, openly released Indic speech dataset spanning multiple Indian languages, collected across districts of India. Learn more at vaani.iisc.ac.in or read the paper.
The dataset consists of three types of annotated noise events, totalling ~154.6 hours of training audio across 90,637 segments. An additional 10 hours of gold-standard audio will serve as the test set, with ground-truth timestamps held back for automated evaluation. Effectively utilising data annotated at different quality levels is a key part of the challenge.
Sample Preview on HuggingFace| # | Annotation Type | Duration (hrs) | Segments | Description |
|---|---|---|---|---|
| 1 | Verified Timestamps (๐ฅ Gold) | 21.8 | 11,111 | Noise events with precise timestamps where mutual agreement between multiple annotators has been verified |
| 2 | Unverified Timestamps (๐ฅ Silver) | 100.32 | 61,642 | Annotated noise events with timestamps, but agreement between annotators is not verified |
| 3 | No Timestamps (๐ฅ Bronze) | 32.42 | 17,884 | Only noise event tags present in the transcript โ no onset/offset timestamps |
| Training Total | 154.6 | 90,637 | ||
Registration is now closed (9th September 2026)
15th August 2026
4th September 2026 (released)
20th September 2026 Extended to 22nd September 2026 (due to Codabench downtime) โ Top teams selected for half-marathon prizes (both tracks). Track 2 material submission (Google Form) closes 24th September 2026, 11:59 PM IST.
15th October 2026 Extended to 17th October 2026 (2-day extension, due to Codabench downtime)
TBA
18โ21 December 2026
All deadlines will be at 12:00 Noon IST (Indian Standard Time).
A total prize pool of โน2,00,000 โ โน1,00,000 (1 lakh) per track, awarded across the top teams in each track.
Top teams will be invited to present their solutions at IndoML 2026, in front of leading researchers from academia and industry.
An expert panel award for the most original methodological contribution: new architectures, novel training regimes, or unsupervised approaches.
Total budget: โน2,00,000. Distributed across Half-Marathon, Final Stage, and Spotlight awards.
Awarded on 22nd September 2026 (extended from 20th September due to Codabench downtime) based on leaderboard standings at the midpoint. Note: The leaderboard will not be reset after the half-marathon.
| Category | Per Team | Track 1 | Track 2 | Total |
|---|---|---|---|---|
| ๐ฅ๐ฅ๐ฅ Ranks 1โ3 | โน5,000 | โน15,000 | โน15,000 | โน30,000 |
| Ranks 4โ8 | โน1,000 | โน5,000 | โน5,000 | โน10,000 |
| Half-Marathon Total | โน40,000 | |||
Ranking: Leaderboard (80%) + Novelty (15%) + Report (5%)
| Category | Track 1 | Track 2 | Total |
|---|---|---|---|
| ๐ฅ 1st Place | โน35,000 | โน35,000 | โน70,000 |
| ๐ฅ 2nd Place | โน15,000 | โน15,000 | โน30,000 |
| ๐ฅ 3rd Place | โน10,000 | โน10,000 | โน20,000 |
| 4thโ8th Place (โน3,000 each) | โน15,000 | โน15,000 | โน30,000 |
| Final Stage Total | โน1,50,000 | ||
Half-Marathon โน40K + Final Stage โน1.5L + Spotlight โน10K (Track 2)
Anyone based in India can participate โ students, researchers, and industry professionals are all welcome. Each team must include at least one member affiliated with an Indian university, research institution, or organisation based in India.
There is no strict cap, but based on previous editions the sweet spot is 3โ4 members. Slightly larger teams are fine, though very large teams are discouraged. Each participant may only join one team.
Yes, there is no restriction. You can participate in one or both tracks โ it's entirely up to you.
No, everyone proceeds to Phase 2. Phase 1 (Half-Marathon) is an intermediate checkpoint with its own prizes, like a half-marathon before the full marathon. The leaderboard is not reset โ all teams continue into Phase 2 regardless of their Phase 1 standing.
The leaderboard is ranked by the Combined score. For Track 1, this is F1 + Dice. For Track 2, this is SI-SDR + 100 ร ฮWER (fraction). Individual metric scores are shown for transparency, but the Combined score determines your rank.
Go to the Codabench competition page (Track 1 or Track 2), then open "Get Started" โ "Files". Download input_data there (the validation dataset is available in this section for both tracks). Training data is available on Hugging Face.
Registration is now closed โ Google Form registration closed on 9th September 2026 at 12:00 PM IST. Teams that have already registered can continue to make submissions on Codabench.
We follow an open model and open data policy. Teams may use any publicly available, closed-source, or proprietary models, along with additional data or augmentation strategies.
Track 1 (Detection): Combined = Event-based F1 + Segment Dice. Track 2 (Removal): Combined = SI-SDR + 100 ร ฮWER. Top-5 entries in Track 2 are additionally evaluated on PESQ. Final standings for top-5 in each track are adjusted by an expert Novelty Score.
Top-performing teams will be invited to present at IndoML 2026. Details regarding travel support will be communicated later.
A public benchmark for noise-event-aware speech enhancement on Indic audio โ a gap that currently has no widely adopted dataset.
Open-sourced winning systems, raising the floor of available denoising tools for Indian-language ASR.
A reusable evaluation harness pairing event-detection metrics with downstream ฮWER on real audio.
Check out last year's edition: Datathon@IndoML 2025 - Evaluating LLM-Powered AI Tutors