CodeBERTScore: an automatic metric for code generation, based on BERTScore

EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation

MAchine Translation Evaluation Online (MATEO)

AUTOMATIC ROMANIAN TEXT GENERATION USING GPT-2

Medical Question Answering System using T5 model, fine-tuned on PubMed data with BLEU, ROUGE, and BERTScore evaluation.

Experimenting changing loss function in T5 to BERTScore

About BertScore

Code and data from the master’s thesis “Decoding Spatial Semantics”. Analyzes and compares open-source LLMs and NMT systems in translating spatial prepositions from English to Brazilian Portuguese. Includes preprocessing scripts, datasets, and evaluation metrics.

Fine-tuning GPT-3.5 and Llama3 LLMs for enhanced persona consistency in chatbots using Google's Synthetic Persona Chat dataset

Summarization, clastering and characterization of text categories using LLM

Detecting and Mitigating Self Contradictory Hallucinations in LLMs using a Multi-Agent System and Stepback Prompting

The work presented was developed during the internship, as researchers in the field of Natural Language Generation, at the Insid&s Lab laboratory in Milan-Bicocca. The work carried out deals with the creation of a framework for the correct assessment of the impact of the quality of the input datasets on the quality of the text generated by the N…