Skip to content

Commit 24da966

Browse files
Reorganize research projects by CV order and add video links
1 parent c104f15 commit 24da966

1 file changed

Lines changed: 15 additions & 9 deletions

File tree

research.md

Lines changed: 15 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ a unified data-driven abstraction framework. This approach decouples high-fideli
1717

1818
## Research Projects
1919

20-
### 1. (NPE - Most Recent)
20+
### 1. Geometry-Aware Neural Physics Engine for Vision Tactile Sensor
2121
This research focuses on enabling real-time, high-fidelity simulation of contact mechanics for robotic manipulation. Standard rigid-body simulators use simplified contact models that fail to capture the complex deformation of soft sensors, while numerical solvers are too slow for online interaction.
2222

2323
will be submittedd
@@ -39,7 +39,7 @@ Takeaway The Neural Physics Engine achieves sub-millimeter accuracy in predictin
3939

4040
---
4141

42-
### 2. DIGIT Sensor & Tactile Simulation (Humanoids Conference)
42+
### 2. DIGIT Sensor & Tactile Simulation
4343
This work addresses the data scarcity issue in vision-based tactile sensing, where high-resolution visual data exists but lacks corresponding physical ground truth such as force and deformation fields. Existing simulators often prioritize visual realism over mechanical accuracy, limiting their utility for physically grounded learning.
4444

4545
**Demo Video:**
@@ -61,8 +61,14 @@ The framework creates a closed loop between the visual and physical domains, ena
6161

6262
--
6363

64-
### 3. Soft Robot Control & Simulation Framework (AIS Journal)
65-
Implementation of high-fidelity simulation and surrogate models for soft robot control using physics-based learning.
64+
### 3. Surrogate Model for Soft Robot Dynamics
65+
This research aims to resolve the trade-off between physical fidelity and computational speed in simulating soft robots for reinforcement learning. High-fidelity finite element method simulations are accurate but too slow for learning, while rigid-body simulators are fast but lack physical realism regarding deformation.
66+
67+
**Demo Video:**
68+
<video width="100%" controls>
69+
<source src="/Videos/topic2.mp4" type="video/mp4">
70+
Your browser does not support the video tag.
71+
</video>
6672

6773
**Demo Video:**
6874
<video width="100%" controls>
@@ -71,11 +77,11 @@ Implementation of high-fidelity simulation and surrogate models for soft robot c
7177
</video>
7278

7379

74-
**Technologies:**
75-
- SOFA Framework
76-
- FEM simulation
77-
- Neural network integration
78-
- Sim2Real transfer learning
80+
**Methods**
81+
The framework employs a data-driven surrogate modeling approach. A high-fidelity simulation is first calibrated to the real robot and then compressed using model order reduction to generate a training dataset. A transformer-based physics-informed neural network is trained to learn the forward dynamics from this data. This learned model is then mapped to a simplified virtual kinematic chain (surrogate) within a fast physics engine, enabling rapid policy training.
82+
83+
**Main Takeaway**
84+
The surrogate model successfully bridges the reality gap, allowing reinforcement learning policies trained in a fast simulation to transfer zero-shot to a physical soft manipulator for trajectory tracking and force control tasks. This method provides a scalable pipeline for training soft robots by decoupling accurate physics generation from runtime execution.
7985

8086
**Links:**
8187
- 🔗 [GitHub Repository](https://github.com/ndolphin-github/Sim2Real_framework_SoftRobot)

0 commit comments

Comments
 (0)