Search Results for author: Joseph Marvin Imperial

Found 19 papers, 10 papers with code

Introducing v0.5 of the AI Safety Benchmark from MLCommons

1 code implementation18 Apr 2024 Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, Victor Akinwande, Namir Al-Nuaimi, Najla Alfaraj, Elie Alhajjar, Lora Aroyo, Trupti Bavalatti, Borhane Blili-Hamelin, Kurt Bollacker, Rishi Bomassani, Marisa Ferrara Boston, Siméon Campos, Kal Chakra, Canyu Chen, Cody Coleman, Zacharie Delpierre Coudert, Leon Derczynski, Debojyoti Dutta, Ian Eisenberg, James Ezick, Heather Frase, Brian Fuller, Ram Gandikota, Agasthya Gangavarapu, Ananya Gangavarapu, James Gealy, Rajat Ghosh, James Goel, Usman Gohar, Sujata Goswami, Scott A. Hale, Wiebke Hutiri, Joseph Marvin Imperial, Surgan Jandial, Nick Judd, Felix Juefei-Xu, Foutse khomh, Bhavya Kailkhura, Hannah Rose Kirk, Kevin Klyman, Chris Knotz, Michael Kuchnik, Shachi H. Kumar, Chris Lengerich, Bo Li, Zeyi Liao, Eileen Peters Long, Victor Lu, Yifan Mai, Priyanka Mary Mammen, Kelvin Manyeki, Sean McGregor, Virendra Mehta, Shafee Mohammed, Emanuel Moss, Lama Nachman, Dinesh Jinenhally Naganna, Amin Nikanjam, Besmira Nushi, Luis Oala, Iftach Orr, Alicia Parrish, Cigdem Patlak, William Pietri, Forough Poursabzi-Sangdeh, Eleonora Presani, Fabrizio Puletti, Paul Röttger, Saurav Sahay, Tim Santos, Nino Scherrer, Alice Schoenauer Sebag, Patrick Schramowski, Abolfazl Shahbazi, Vin Sharma, Xudong Shen, Vamsi Sistla, Leonard Tang, Davide Testuggine, Vithursan Thangarasa, Elizabeth Anne Watkins, Rebecca Weiss, Chris Welty, Tyler Wilbers, Adina Williams, Carole-Jean Wu, Poonam Yadav, Xianjun Yang, Yi Zeng, Wenhui Zhang, Fedor Zhdanov, Jiacheng Zhu, Percy Liang, Peter Mattson, Joaquin Vanschoren

We created a new taxonomy of 13 hazard categories, of which 7 have tests in the v0. 5 benchmark.

Standardize: Aligning Language Models with Expert-Defined Standards for Content Generation

no code implementations19 Feb 2024 Joseph Marvin Imperial, Gail Forey, Harish Tayyar Madabushi

Domain experts across engineering, healthcare, and education follow strict standards for producing quality content such as technical manuals, medication instructions, and children's reading materials.

GPT-4 In-Context Learning +2

BasahaCorpus: An Expanded Linguistic Resource for Readability Assessment in Central Philippine Languages

1 code implementation17 Oct 2023 Joseph Marvin Imperial, Ekaterina Kochmar

Current research on automatic readability assessment (ARA) has focused on improving the performance of models in high-resource languages such as English.

CebuaNER: A New Baseline Cebuano Named Entity Recognition Model

1 code implementation1 Oct 2023 Ma. Beatrice Emanuela Pilar, Ellyza Mari Papas, Mary Loise Buenaventura, Dane Dedoroy, Myron Darrel Montefalcon, Jay Rhald Padilla, Lany Maceda, Mideth Abisado, Joseph Marvin Imperial

Despite being one of the most linguistically diverse groups of countries, computational linguistics and language processing research in Southeast Asia has struggled to match the level of countries from the Global North.

named-entity-recognition Named Entity Recognition +1

Flesch or Fumble? Evaluating Readability Standard Alignment of Instruction-Tuned Language Models

1 code implementation11 Sep 2023 Joseph Marvin Imperial, Harish Tayyar Madabushi

Readability metrics and standards such as Flesch Kincaid Grade Level (FKGL) and the Common European Framework of Reference for Languages (CEFR) exist to guide teachers and educators to properly assess the complexity of educational materials before administering them for classroom use.

Automatic Readability Assessment for Closely Related Languages

1 code implementation22 May 2023 Joseph Marvin Imperial, Ekaterina Kochmar

Consequently, when both linguistic representations are combined, we achieve state-of-the-art results for Tagalog and Cebuano, and baseline scores for ARA in Bikol.

Uniform Complexity for Text Generation

1 code implementation11 Apr 2022 Joseph Marvin Imperial, Harish Tayyar Madabushi

Large language models (LLMs) have shown promising results in a wide array of generative NLP tasks, such as summarization and machine translation.

Machine Translation Question Answering +1

NU HLT at CMCL 2022 Shared Task: Multilingual and Crosslingual Prediction of Human Reading Behavior in Universal Language Space

1 code implementation CMCL (ACL) 2022 Joseph Marvin Imperial

In this paper, we present a unified model that works for both multilingual and crosslingual prediction of reading times of words in various languages.

Under the Microscope: Interpreting Readability Assessment Models for Filipino

no code implementations1 Oct 2021 Joseph Marvin Imperial, Ethel Ong

Readability assessment is the process of identifying the level of ease or difficulty of a certain piece of text for its intended audience.

BIG-bench Machine Learning

Diverse Linguistic Features for Assessing Reading Difficulty of Educational Filipino Texts

no code implementations31 Jul 2021 Joseph Marvin Imperial, Ethel Ong

In order to ensure quality and effective learning, fluency, and comprehension, the proper identification of the difficulty levels of reading materials should be observed.

How Do Pedophiles Tweet? Investigating the Writing Styles and Online Personas of Child Cybersex Traffickers in the Philippines

no code implementations21 Jul 2021 Joseph Marvin Imperial

One of the most important humanitarian responsibility of every individual is to protect the future of our children.

Humanitarian

BERT Embeddings for Automatic Readability Assessment

1 code implementation RANLP 2021 Joseph Marvin Imperial

Automatic readability assessment (ARA) is the task of evaluating the level of ease or difficulty of text documents for a target audience.

Text Classification

A Simple Post-Processing Technique for Improving Readability Assessment of Texts using Word Mover's Distance

no code implementations12 Mar 2021 Joseph Marvin Imperial, Ethel Ong

Assessing the proper difficulty levels of reading materials or texts in general is the first step towards effective comprehension and learning.

A Simple Disaster-Related Knowledge Base for Intelligent Agents

no code implementations PACLIC 2020 Clark Emmanuel Paulo, Arvin Ken Ramirez, David Clarence Reducindo, Rannie Mark Mateo, Joseph Marvin Imperial

The context-specific knowledge base developed from this study can be adapted by intelligent agents such as chat bots integrated in platforms such as Facebook Messenger for answering disaster-related queries.

Word Embeddings

Application of Lexical Features Towards Improvement of Filipino Readability Identification of Children's Literature

no code implementations22 Jan 2021 Joseph Marvin Imperial, Ethel Ong

Proper identification of grade levels of children's reading materials is an important step towards effective learning.

Sentence

Cannot find the paper you are looking for? You can Submit a new open access paper.