Research

2024

Evaluating Human-Centered AI Explanations: Introduction of an XAI Evaluation Framework for Fact-Checking.

Vera Schmitt; Balazs Csomor; Joachim Meyer; Luis-Felipe Villa-Arenas; Charlott Jakob; Tim Polzehl; Sebastian Möller.
In Proceedings of the 3rd ACM International Workshop on Multimedia AI against Disinformation. ACM International Workshop on Multimedia AI against Disinformation (MAD-24), ISBN 979-8-4007-05526, Association for Computing Machinery, New York, NY, USA, 2024.

17 Visual and audio scene classification for detecting discrepancies in video: A baseline method and experimental protocol. Proceedings of the 3rd ACM International Workshop on Multimedia AI against Disinformation, 30 – 36-

Apostolidis, K., Abesser, J., Cuccovillo, L., & Mezaris, V. (2024).

16 “Augmented Political Leaning Detection: Leveraging Parliamentary Speeches for Classifying News Articles.”

akob, Charlott, Pia Wenzel, Salar Mohtaj, and Vera Schmitt.
In: Proceedings of the 4th Workshop on Computational Linguistics for the Political and Social Sciences: Long and short papers, pp. 126-133. 2024.

15 Implications of Regulations on Large Generative AI Models in the Super-Election Year and the Impact on Disinformation.

Vera Schmitt; Jakob Tesch; Eva Lopez; Tim Polzehl; Aljoscha Burchardt; Konstanze Neumann; Salar Mohtaj; Sebastian Möller.
In Proceedings of the Workshop on Legal and Ethical Issues in Human Language Technologies @ LREC-COLING 2024. Legal and Ethical Issues in Human Language Technologies (LEGAL-2024), located at LREC-Coling 2024, May 20, Torino, Italy, Pages 28-38, ELRA and ICCL, 2024.

14 “From Construction to Application: Advancing Argument Mining with the Large-Scale KIALOPRIME Dataset.”

Sahitaj, Premtim, Ramon Ruiz-Dolz, Ariana Sahitaj, Ata Nizamoglu, Vera Schmitt, Salar Mohtaj, and Sebastian Möller.
In: Computational Models of Argument, pp. 229-240. IOS Press, 2024.

13 “NewsPolyML: Multi-lingual European News Fake Assessment Dataset.”

Mohtaj, Salar, Ata Nizamoglu, Premtim Sahitaj, Vera Schmitt, Charlott Jakob, and Sebastian Möller.
In Proceedings of the 3rd ACM International Workshop on Multimedia AI against Disinformation, pp. 82-90. 2024.

12 Audio Transformer for Synthetic Speech Detection via Formant Magnitude and Phase Analysis.

Cuccovillo, L., Gerhardt, M., & Aichroth, P. (2024a).
ICASSP 2024 – 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4805–4809.

11 “Towards a computational framework for distinguishing critical and conspiratorial texts by elaborating on the context and argumentation with LLMs.”

Sahitaj, Ariana, Premtim Sahitaj, Salar Mohtaj, Sebastian Möller, and Vera Schmitt.
Working Notes of CLEF (2024).

10 Audio Transformer for Synthetic Speech Detection via Multi-Formant Analysis.

Cuccovillo, L., Gerhardt, M., & Aichroth, P. (2024b).
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 4409–4417.

09 The Role of Explainability in Collaborative Human-AI Disinformation Detection.

Schmitt, V., Villa-Arenas, L., Feldhus, N., Meyer, J., Spang, R., and Möller, S., 2024.
In The 2023 ACM Conference on Fairness, Accountability, and Transparency (FACCT ’24).

08 Evaluating Human- Centered AI Explanations: Introduction of an XAI Evaluation Framework for Fact-Checking (MAD ’24).

Schmitt, V., Csomor, B., Meyer, J., Villa-Arenas, L., Jakob, C., Polzehl, T., and Möller, S. 2024.
Association for Computing Machinery, New York, NY, USA.

07 “Cross-Refine: Improving Natural Language Explanation Generation by Learning in Tandem.”

Wang, Qianli, Tatiana Anikina, Nils Feldhus, Simon Ostermann, Sebastian Möller, and Vera Schmitt.
arXiv preprint arXiv:2409.07123 (2024).

06 “Anchored Alignment for Self-Explanations Enhancement.”

Villa-Arenas, Luis Felipe, Ata Nizamoglu, Qianli Wang, Sebastian Möller, and Vera Schmitt.
arXiv preprint arXiv:2410.13216 (2024).

05 Audio Provenance Analysis in Heterogeneous Media Sets.

Gerhardt, M., Cuccovillo, L., & Aichroth, P. (2024).
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 4387–4396.

04 MAD ’24 Workshop: Multimedia AI against Disinformation.

Stanciu, C., Ionescu, B., Cuccovillo, L., Papadopoulos, S., Kordopatis-Zilos, G., Popescu, A., & Caldelli, R. (2024).
Proceedings of the 2024 International Conference on Multimedia Retrieval, 1339–1341.

03 “Implications of Regulations on Large Generative AI Models in the Super-Election Year and the Impact on Disinformation.”

Schmitt, Vera, Jakob Tesch, Eva Lopez, Tim Polzehl, Aljoscha Burchardt, Konstanze Neumann, Salar Mohtaj, and Sebastian Möller.
In Proceedings of the Workshop on Legal and Ethical Issues in Human Language Technologies@ LREC-COLING 2024, pp. 28-38. 2024.

02 Audio Transformer for Synthetic Speech Detection via Benford’s Law Distribution Analysis.

Talagini Ashoka, A. B., Cuccovillo, L., & Aichroth, P. (2024).
Proceedings of the 3rd ACM International Workshop on Multimedia AI against Disinformation, 23–29.

01

2023

Calibrating Neural Networks for Synthetic Speech Detection.

Cuccovillo, L., Aichroth, P., & Köllmer, T. (2024) & L., Gerhardt, M., & Aichroth, P. (2023, Dezember).
In: A Likelihood-Ratio-Based Approach. Journal of the Audio Engineering Society. Audio Spectrogram Transformer for Synthetic Speech Detection via Speech Formant Analysis. 2023 IEEE International Workshop on Information Forensics and Security (WIFS).

11 Fighting Disinformation: Overview of Recent AI-Based Collaborative Human-Computer Interaction for Intelligent Decision Support Systems.

Tim Polzehl; Vera Schmitt; Nils Feldhus; Joachim Meyer; Sebastian Möller.
In: Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications – HUCAPP,. International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP-2022), Pages 267-278, ISBN 978-989-758-634-7, SciTePress, 2023.

10 RCT-Net: TDNN based Speaker Verification with 2D Res2Nets on Frame Level Feature Extractor.

Razieh Khamsehashari; Fengying Miao; Tim Polzehl; Sebastian Möller.
In: The Eighth International Conference on Advances in Signal, Image and Video Processing – SIGNAL 2023. International Conference on Advances in Signal, Image and Video Processing (SIGNAL-2023), March 13-17, Barcelona, Spain, ISBN 978-1-68558-057-5, IARIA, 2023.

09 Domain Adversarial Training for German Accented Speech Recognition.

Carlos Franzreb; Tim Polzehl.
In: DAGA 2023 – 49. Jahrestagung für Akustik. Deutsche Jahrestagung für Akustik (DAGA-2023), 49. March 6-9, Hamburg, Germany, Pages 1413-1416, ISBN 978-3-939296-21-8, DEGA e.V, 2023.

08 StarGAN-VC++: Towards Emotion Preserving Voice Conversion Using Deep Embeddings.

Arnab Das; Suhita Ghosh; Tim Polzehl; Ingo Siegert; Sebastian Stober (Pblishr.)
ISCA Tutorial and Research Workshop on Speech Synthesis (SSW-2023), Grenoble, France, ISCA Speech Synthesis Workshop, 2023.

07 Emo-StarGAN: A Semi-Supervised Any-to-Many Non-Parallel Emotion-Preserving Voice Conversion.

Suhita Ghosh; Arnab Das; Yamini Sinha; Ingo Siegert; Tim Polzehl; Sebastian Stober.
In: Proc. INTERSPEECH 2023. Conference in the Annual Series of Interspeech Events (INTERSPEECH-2023), Pages 2093-2097, ISCA-speech, 2023.

06 How Risky is Multimodal Fake News Detection? A Review of Cross-Modal Learning Approaches under EU AI Act Constrains.

Razieh Khamsehashari; Vera Schmitt; Tim Polzehl; Salar Mohtaj; Sebastian Möller.
In: Proc. 3rd Symposium on Security and Privacy in Speech Communication. Conference in the Annual Series of Interspeech Events (INTERSPEECH-2023), Pages 1-10, ISCA, 2023.

05 Advancing Audio Phylogeny: A Neural Network Approach for Transformation Detection.

Gerhardt, M., Cuccovillo, L., & Aichroth, P. (2023).
2023 IEEE International Workshop on Information Forensics and Security (WIFS), 1–6.

04 “How Risky is Multimodal Fake News Detection? A Review of Cross-Modal Learning Approaches under EU AI Act Constrains.”

Khamsehashari, Razieh, et al
Proc. 3rd Symposium on Security and Privacy in Speech Communication.

03 “Fighting Disinformation: Overview of Recent AI-Based Collaborative Human-Computer Interaction for Intelligent Decision Support Systems.”

Polzehl, Tim, et al.
VISIGRAPP (2: HUCAPP) (2023): 267-278.

02 An Open Dataset of Synthetic Speech.

Yaroshchuk, A., Papastergiopoulos, C., Cuccovillo, L., Aichroth, P., Votis, K., & Tzovaras, D. (2023, Dezember).
2023 IEEE International Workshop on Information Forensics and Security (WIFS).