Here's what audio/video cables look like.
Audio/video cables go out of your VCR and in to your WebTV box.
You can use audio/video cables alone, or in addition to using a coaxial splitter.