[en] In this thesis we study the dynamics as well as the resulting gravitational radiation from eccentric binaries of compact objects in the non-linear regime of General Relativity. For this purpose we solve Einstein's field equation numerically in a 3+1 decomposition using the moving-puncture technique. We focus our study on very particular orbits, arising as a purely relativistic phenomenon of the two-body problem in General Relativity, which are associated with unstable circular orbits. They are governed by a fast, nearly circular revolution at a short distance followed by a slow, radial motion on a nearly elliptic trajectory. Due to the unique features of their orbital trajectories they are called zoom-whirl orbits. We analyze how the peculiar dynamics manifests itself in the emitted gravitational radiation and to which extent one can infer the orbital properties from observations of the gravitational waves. In the first part, we consider black hole binaries. We perform a comprehensive parameter study by varying the initial eccentricity, computing and characterizing the resulting gravitational waveforms. We address aspects, which can only be obtained from non-perturbative methods, and which are crucial to the astrophysical relevance of these orbits. In particular, our results imply a fairly low amount of fine-tuning necessary to spot zoom-whirl effects. We find whirl orbits for values of the eccentricities, which fall in disjunct intervals extending to rather low values. Furthermore, we show that whirl effects just before merger cause a signal with significant amplitude. In the second part, we investigate neutron star binaries on eccentric orbits in full General Relativity, which has not been studied so far. We explore their phenomenology and study the consequences for the matter after the neutron stars have merged. In these evolutions the merged neutron stars sooner or later collapse to form a black hole. During the collapse most of the matter is accreted on to the black hole, but in general a non-negligible amount may form an accretion disk around the merger remnant. Depending on the initial eccentricity, we find that a disk of substantial mass is left behind. We give strong evidence that the disk masses for a considerable range of eccentricities are generically large enough to power a short gamma-ray burst. Furthermore we find strong tidal interactions, when the neutron stars orbit close to each other, exerting a strong perturbation on the internal dynamics of the stars. We demonstrate that this effect modifies the gravitational waveform in a characteristic way. Our results emphasize the potential of gravitational waves from eccentric neutron star binaries to constrain models for the unknown equation of state of the neutron star material.