An example of an orthonormal system which is complete but not closed may be found here. For another example, see Prof. Michael Cwikel's Fourier page.