Skip to content

Discrepancy in Metric Calculation (WER, U-WER, B-WER, Recall) onMALA-ASR with Slidespeech Test Set #203

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Caesarhhh opened this issue Feb 20, 2025 · 1 comment
Assignees

Comments

@Caesarhhh
Copy link

I ran inference using the Slidespeech test set on MALA-ASR and generated thedecode_test beam4_pred and decode test beam4 gt files. However, the metrics(WER, U-WER, B-WER, Recall) I calculated from these files differ significantly from the results reported in the paper. Could you please provide the code used to compute these metrics for the experiments in the paper?

@yanghaha0908
Copy link
Collaborator

The code has been uploaded to #208.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants