The cyclic nucleotide-gated (CNG) cation channel of rod photoreceptors is a heterotetramer consisting of homologous CNGA1 and CNGB1a subunits. While CNGA1 is indispensable for channel activation, the specific role of CNGB1a in this process has remained elusive. Here, we show that the N-terminal glutamic acid-rich protein (GARP) domain of CNGB1a and soluble GARP2, which corresponds to the proximal portion of the GARP domain, act as autoinhibitory domains that decrease the opening probability of the CNG channel. In the presence of mutations that structurally impair the cyclic nucleotide-binding domain (CNBD) of CNGB1a, the GARP domain completely abolishes channel activity. In agreement with an inhibitory function of GARP, the activity of mutant CNG channels could be fully restored by deletion of the GARP domain. We identified two sequences within the GARP domain that confer most of the inhibitory effect and demonstrate that the profound inhibition imposed by the GARP domain is caused by direct and autonomous protein–protein interaction with the CNG channel complex. In wild-type rod CNG channels, this inhibitory effect can be relieved by binding of cGMP to the CNBD of CNGB1a. In conclusion, we propose that the N terminus of CNGB1a and soluble GARPs act as molecular gate keepers that control the activation of heteromeric rod CNG channels. Our results suggest that the GARP domain has evolved in rod photoreceptors to reduce current noise resulting from openings of CNG channels in the absence of cGMP.