Membrane trafficking is regulated by small Ras-like GDP/GTP binding proteins of the Rab subfamily (Rab GTPases) that cycle between membranes and cytosol depending on their nucleotide state. The GDP dissociation inhibitor (GDI) solubilizes prenylated Rab GTPases from and shuttles them between membranes in the form of a soluble cytosolic complex. We use attenuated total reflection–Fourier transform infrared spectroscopy to directly observe extraction of Rab GTPases from model membranes by GDI. In their native form, most Rab GTPases are doubly geranylgeranylated at the C terminus to achieve localization to the membrane. We find that monogeranylgeranylated Rab35 and Rab1b reversibly bind to a negatively charged model membrane. Correct folding and GTPase activity of the membrane-bound protein can be evaluated. The dissociation kinetics depends on the C-terminal sequence and charge of the GTPases. The attenuated total reflection experiments show that GDI genuinely accelerates the intrinsic Rab membrane dissociation. The extraction process is characterized and occurs in a nucleotide-dependent manner. Furthermore, we find that phosphocholination of Rab35, which is catalyzed by the Legionella pneumophila protein AnkX, interferes with the ability of GDI to extract Rab35 from the membrane. The attenuated total reflection–Fourier transform infrared spectroscopy approach enables label-free investigation of the interaction between GDI and Rab GTPases in a membrane environment. Thereby, GDI is revealed to actively extract monogeranylgeranylated membrane-bound Rab GTPases and, thus, is not merely a solubilization factor.