Irradiation creep and irradiation swelling are two of the lifetime limiting factors for structural materials in nuclear reactors. These mechanical effects are driven by irradiation defect evolution and the interaction of those defects with dislocations in the microstructure. We present here a coupled cluster dynamics – crystal plasticity approach to model irradiation swelling and creep behavior in 316 SS. The time-dependent evolution of irradiation defects is calculated with a cluster dynamics approach and passed to the crystal plasticity model to compute the dislocation evolution. We show the impact of the irradiation defect evolution on the stress state in the material, which drives inelastic deformation through dislocation motion. The inelastic deformation in the 316 SS is dependent on the dose rate, where the inelastic deformation driven by the early-stage irradiation defect evolution determines the mechanical behavior of the 316 SS.