All of those players sat out Friday's workout, as did cornerback Alan Ball, who has a sore foot. Kubiak had already ruled out linebacker Brooks Reed, who's sidelined indefinitely with a groin injury.
The Texans (10-1) can clinch a playoff spot with win in Tennessee (4-7).
Joseph (hamstring), Caldwell (hamstring), Newton (right knee) and James (hamstring) have sat out practices all week. Ball will be a game-time decision.