NeMo-Aligner: Scalable Toolkit for Efficient Model Alignment

1 code implementation • 2 May 2024 • Gerald Shen, Zhilin Wang, Olivier Delalleau, Jiaqi Zeng, Yi Dong, Daniel Egert, Shengyang Sun, Jimmy Zhang, Sahil Jain, Ali Taghibakhshi, Markel Sanz Ausin, Ashwath Aithal, Oleksii Kuchaiev

However, building efficient tools to perform alignment can be challenging, especially for the largest and most competent LLMs which often contain tens or hundreds of billions of parameters.

Nemotron-4 15B Technical Report

no code implementations • 26 Feb 2024 • Jupinder Parmar, Shrimai Prabhumoye, Joseph Jennings, Mostofa Patwary, Sandeep Subramanian, Dan Su, Chen Zhu, Deepak Narayanan, Aastha Jhunjhunwala, Ayush Dattagupta, Vibhu Jawa, Jiwei Liu, Ameya Mahabaleshwarkar, Osvald Nitski, Annika Brundyn, James Maki, Miguel Martinez, Jiaxuan You, John Kamalu, Patrick Legresley, Denys Fridman, Jared Casper, Ashwath Aithal, Oleksii Kuchaiev, Mohammad Shoeybi, Jonathan Cohen, Bryan Catanzaro

We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual language model trained on 8 trillion text tokens.

Language Modelling

Hierarchical Graph Neural Network with Cross-Attention for Cross-Device User Matching

no code implementations • 6 Apr 2023 • Ali Taghibakhshi, Mingyuan Ma, Ashwath Aithal, Onur Yilmaz, Haggai Maron, Matthew West

Cross-device user matching is a critical problem in numerous domains, including advertising, recommender systems, and cybersecurity.

Recommendation Systems

3D Object Detection on Point Clouds using Local Ground-aware and Adaptive Representation of scenes' surface

no code implementations • 2 Feb 2020 • Arun CS Kumar, Disha Ahuja, Ashwath Aithal

A novel, adaptive ground-aware, and cost-effective 3D Object Detection pipeline is proposed.

3D Object Detection Object +1