Search Results for author: Chayan Sarkar

Found 9 papers, 1 papers with code

tagE: Enabling an Embodied Agent to Understand Human Instructions

1 code implementation24 Oct 2023 Chayan Sarkar, Avik Mitra, Pradip Pramanick, Tapas Nayak

At its core, our system employs an inventive neural network model designed to extract a series of tasks from complex task instructions expressed in natural language.

Natural Language Understanding Question Answering +1

I can attend a meeting too! Towards a human-like telepresence avatar robot to attend meeting on your behalf

no code implementations28 Jun 2020 Hrishav Bakul Barua, Chayan Sarkar, Achanna Anil Kumar, Arpan Pal, Balamuralidhar P

In this work, we focus on a telepresence robot that can be used to attend a meeting remotely with a group of people.

DeComplex: Task planning from complex natural instructions by a collocating robot

no code implementations23 Aug 2020 Pradip Pramanick, Hrishav Bakul Barua, Chayan Sarkar

However, it is not trivial to execute the human intended tasks as natural language expressions can have large linguistic variations.

Let me join you! Real-time F-formation recognition by a socially aware robot

no code implementations23 Aug 2020 Hrishav Bakul Barua, Pradip Pramanick, Chayan Sarkar, Theint Haythi Mg

Our proposed pipeline consists of -- a) a skeletal key points estimator (a total of 17) for the detected human in the scene, b) a learning model (using a feature vector based on the skeletal points) using CRF to detect groups of people and outlier person in a scene, and c) a separate learning model using a multi-class Support Vector Machine (SVM) to predict the exact F-formation of the group of people in the current scene and the angle of approach for the viewing robot.

Outlier Detection

Enabling human-like task identification from natural conversation

no code implementations23 Aug 2020 Pradip Pramanick, Chayan Sarkar, Balamuralidhar P, Ajay Kattepur, Indrajit Bhattacharya, Arpan Pal

In this work, we provide a non-trivial method to combine an NLP engine and a planner such that a robot can successfully identify tasks and all the relevant parameters and generate an accurate plan for the task.

Scheduling

DoRO: Disambiguation of referred object for embodied agents

no code implementations28 Jul 2022 Pradip Pramanick, Chayan Sarkar, Sayan Paul, Ruddra dev Roychoudhury, Brojeshwar Bhowmick

Given an area where the intended object is, DoRO finds all the instances of the object by aggregating observations from multiple views while exploring & scanning the area.

Natural Language Understanding Object

Can Visual Context Improve Automatic Speech Recognition for an Embodied Agent?

no code implementations21 Oct 2022 Pradip Pramanick, Chayan Sarkar

In this work, we present a method to incorporate a robot's visual information into an ASR system and improve the recognition of a spoken utterance containing a visible entity.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

Cannot find the paper you are looking for? You can Submit a new open access paper.