The mean-square exponential stability problem is investigated for a class of stochastic time-varying delay systems with Markovian jumping parameters. By decomposing the delay interval into multiple equidistant subintervals, a new delay-dependent and decay-rate-dependent criterion is presented based on constructing a novel Lyapunov functional and employing stochastic analysis technique. Besides, the decay rate has no conventional constraint and can be selected according to different practical conditions. Finally, two numerical examples are provided to show that the obtained result has less conservatism than some existing ones in the literature.