We discuss in this study the advantages and limitations of the osmotic stress method that enables to set the osmotic pressure to a given system. By investigating aqueous suspension of monodisperse silica nanoparticles of radius 78 at an ionic strength of 10-2 mol/L, we show that the method is very accurate to probe the phase behavior of colloidal suspensions because it allows to prepare samples all along the equation of state of the system at constant ionic strength without any aggregation and with a well defined structure, as shown by Small-Angle Neutron Scattering (SANS) experiments. However the method fails to yield crystalline structures, since solid samples obtained are always glassy, even when the fluid-solid transition is crossed with small successive jumps of 1000 Pa. This phenomenon comes from the kinetics of the process which exhibits in our experimental conditions an exponential decay time with a characteristic time of ≈ 3 hours that induces a very strong change of the volume fraction of the suspension in the early stages of the stress. When the jump of pressure is very important, the system is frozen in the vicinity of the dialysis bag and forms a dense shell that eventually prevents some spatial regions of the sample to reach equilibrium. In this case, the osmotic stress forces the sample to get a structure very spatially heterogeneous at macroscopic scale.