Stochasticity is an intrinsic property of genetic regulatory networks due to the low copy numbers of the major molecular species, such as, DNA, mRNA, and regulatory proteins. Therefore, investigation of the mechanisms that reduce the stochastic noise is essential in understanding the reproducible behaviors of real organisms and is also a key to design synthetic genetic regulatory networks that can reliably work. We use an analytical and systematic method, the linear noise approximation of the chemical master equation along with the decoupling of a stoichiometric matrix. In the analysis of fluctuations of multiple molecular species, the covariance is an important measure of noise. However, usually the representation of a covariance matrix in the natural coordinate system, i.e. the copy numbers of the molecular species, is intractably complicated because reactions change copy numbers of more than one molecular species simultaneously. Decoupling of a stoichiometric matrix, which is a transformation of variables, significantly simplifies the representation of a covariance matrix and elucidates the mechanisms behind the observed fluctuations in the copy numbers. We apply our method to three types of fundamental genetic regulatory networks, that is, a single-gene autoregulatory network, a two-gene autoregulatory network, and a mutually repressive network. We have found that there are multiple noise components differently originating. Each noise component produces fluctuation in the characteristic direction. The resulting fluctuations in the copy numbers of the molecular species are the sum of these fluctuations. In the examples, the limitation of the negative feedback in noise reduction and the trade-off of fluctuations in multiple molecular species are clearly explained. The analytical representations show the full parameter dependence. Additionally, the validity of our method is tested by stochastic simulations.