View PDF (https://arxiv.org/pdf/2607.02862)HTML (experimental) (https://arxiv.org/html/2607.02862v1) Abstract:Automatic Speech Recognition (ASR) and Dialect Identification (DID) are crucial for Indian languages, many of which are low-resource and exhibit significant dialectal differences. Existing methods often optimize ASR or DID individually, resulting in performance trade-offs. In this work, we propose a multimodal framework that jointly improves ASR and DID. Our method employs a Bottleneck Encoder to extract dialectal features from Conformer-based speech representations and a RoBERTa encoder to process ASR-generated CTC embeddings. A gating mechanism merges these features, followed by an attention encoder to refine the representations. The learned embeddings are concatenated with Conformer outputs to enhance ASR features. Evaluated on eight Indian languages with thirty-three dialects, our method achieves an average DID accuracy of 81.63% and average CER and WER of 4.65% and 17.73%, respectively. These results highlight the effectiveness of our method for joint ASR-DID modeling. Subjects:Computation and Language (cs.CL); Audio and Speech Processing (eess.AS) Cite as:arXiv:2607.02862 (https://arxiv.org/abs/2607.02862) [cs.CL] (or arXiv:2607.02862v1 (https://arxiv.org/abs/2607.02862v1) [cs.CL] for this version) https://doi.org/10.48550/arXiv.2607.02862 arXiv-issued DOI via DataCite (pending registration) Submission history From: Prasanta Ghosh Prof. [view email (https://arxiv.org/show-email/403d7a3f/2607.02862)] • *[v1]** Fri, 3 Jul 2026 01:53:05 UTC (220 KB)