Causal RL Framework Aims to Explain and Schedule Maintenance for Soft Robots

A developer describes building an explainable causal reinforcement learning pipeline to maintain bio-inspired soft robots, such as a silicone octopus-like arm that kept developing micro-tears. Standard deep RL agents maximize task reward but cannot identify why hardware is degrading, since soft-body failures like fatigue, hysteresis, creep, and delamination are not directly observable. The approach uses embodied sensing and a structural causal model linking sensor readings, actions, latent degradation, and maintenance events, so the agent can reason about interventions on the causes of wear. The author reports that the rate of change in strain sensor readings was a stronger early failure predictor than absolute values. The write-up presents the method as a way to make maintenance policies both effective and explainable.