Nicolay Rusnachenko

Sounds good, all the best in this route!

Thanks for that grouped findings!
In addition, lost in the middle would fitted around 1-3 for sure:
https://arxiv.org/abs/2307.03172

What a detailed and vebose update! I see, there is a lot of happening here both on a side of the architectural solutions, organization of the fine-tuning, related experiments. My comment on that would be very broad as willing to have a closer look when highlighted ideas would be supported by the related tables as an outcome of experiments. At first glance, the idea of generatlized pre-training following by domain specific fine-tuning sounds quite promising. Besides that, curious if that DHM model and other cliincal-tasks related models would be publicly available

True, especially with NER as a task, BERT fits too well both from the side of the required resources and annotation accuracy.

Pleased for the lightweight architecture implementaiton and filtering feature.
Thank you for sharing this! 👀

Well done to Healthcare contribution and to field of ECG data processing in particular. 👏
Looks like base model mention a lot of concepts (CNN, ViT, GNN) that could individually represent a solution for that propblem or form a processing pipeline. Would it be possible to ask on having a look on the framework diagram / preprint studies for a greater detail?

@Doctor-Chad-PhD , there is a definitely a room of further improvements, including adaptation of the larger instance of the Qwen and other models. Although such details goes beyound the experiments, I might still navigate you to more detailed overview, in which my observations on how to use this framework at larger scale:

https://www.youtube.com/watch?v=uOAiUvLghuE&t=960s

Spoiler: 1️⃣ necessity for more coplex summaries evaluation and 2️⃣ more precise declaration for the extracted clinical key reports.

Finally, organizers of the workshop still keep unpublished results of the other systems (planned to🔓 by the end of August), so and probably the leaderboard of other systems might sort out your question.