You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: research.md
+15-9Lines changed: 15 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@ a unified data-driven abstraction framework. This approach decouples high-fideli
17
17
18
18
## Research Projects
19
19
20
-
### 1. (NPE - Most Recent)
20
+
### 1. Geometry-Aware Neural Physics Engine for Vision Tactile Sensor
21
21
This research focuses on enabling real-time, high-fidelity simulation of contact mechanics for robotic manipulation. Standard rigid-body simulators use simplified contact models that fail to capture the complex deformation of soft sensors, while numerical solvers are too slow for online interaction.
22
22
23
23
will be submittedd
@@ -39,7 +39,7 @@ Takeaway The Neural Physics Engine achieves sub-millimeter accuracy in predictin
This work addresses the data scarcity issue in vision-based tactile sensing, where high-resolution visual data exists but lacks corresponding physical ground truth such as force and deformation fields. Existing simulators often prioritize visual realism over mechanical accuracy, limiting their utility for physically grounded learning.
44
44
45
45
**Demo Video:**
@@ -61,8 +61,14 @@ The framework creates a closed loop between the visual and physical domains, ena
61
61
62
62
--
63
63
64
-
### 3. Soft Robot Control & Simulation Framework (AIS Journal)
65
-
Implementation of high-fidelity simulation and surrogate models for soft robot control using physics-based learning.
64
+
### 3. Surrogate Model for Soft Robot Dynamics
65
+
This research aims to resolve the trade-off between physical fidelity and computational speed in simulating soft robots for reinforcement learning. High-fidelity finite element method simulations are accurate but too slow for learning, while rigid-body simulators are fast but lack physical realism regarding deformation.
66
+
67
+
**Demo Video:**
68
+
<videowidth="100%"controls>
69
+
<sourcesrc="/Videos/topic2.mp4"type="video/mp4">
70
+
Your browser does not support the video tag.
71
+
</video>
66
72
67
73
**Demo Video:**
68
74
<videowidth="100%"controls>
@@ -71,11 +77,11 @@ Implementation of high-fidelity simulation and surrogate models for soft robot c
71
77
</video>
72
78
73
79
74
-
**Technologies:**
75
-
- SOFA Framework
76
-
- FEM simulation
77
-
- Neural network integration
78
-
- Sim2Real transfer learning
80
+
**Methods**
81
+
The framework employs a data-driven surrogate modeling approach. A high-fidelity simulation is first calibrated to the real robot and then compressed using model order reduction to generate a training dataset. A transformer-based physics-informed neural network is trained to learn the forward dynamics from this data. This learned model is then mapped to a simplified virtual kinematic chain (surrogate) within a fast physics engine, enabling rapid policy training.
82
+
83
+
**Main Takeaway**
84
+
The surrogate model successfully bridges the reality gap, allowing reinforcement learning policies trained in a fast simulation to transfer zero-shot to a physical soft manipulator for trajectory tracking and force control tasks. This method provides a scalable pipeline for training soft robots by decoupling accurate physics generation from runtime execution.
0 commit comments