[ EDIT - moved all H.264 settings to this post to avoid duplication; in short: get x264vfw . Mode=Co

I'm going to show you how to encode a video with VirtualDub with the best possible quality (assuming we want to upload to a site like YouTube) using H.264, and also show you how to batch process multiple videos. EDIT as of today (September 2013) I'd recommend getting the 32-bit version of VirtualDub for maximum compatibility with codecs and plug-ins. psd Look on this page for version 1.10. x (experimental), 32-bit (x86). If you don't use VirtualDub but you're looking for good H.264 settings, see this post . If you need a good H.264 encoder, psd get x264vfw . If you need a good AC3 encoder, get AC3 ACM . [Updated Jan '14 to recommend psd AC3 over MP3 audio. Or use uncompressed PCM. See below] Ready? OK! Installing VirtualDub: there's no installation. Unzip to any folder and run VirtualDub.exe; make your own shortcuts and file associations. Then install x264vfw. Run VirtualDub. psd Select File|Open Video File... If you have some clips (say Fraps 4GB AVI segments) you want to join together: rename your files with FrapsJoin first, so they are in a form VirtualDub understands (file names must end with serial numbers, in order) File|Open Video File; select 1st clip File|Append Avi Segment; check "Autodetect additional segments"; select next clip, and all the clips in the series will be added to the timeline. Now you see your video in two windows, like this: (they are called input and output : before and after filter processing, as explained below) I don't use the VirtualDub Input windows at all. I'm just interested in the output. To disable the Input pane, select View|Layout|Output pane only Right-click the windows to zoom in & out. Drag the scrollbar to move around the timeline. You probably won't be able to see a smooth playback of the video if you're looking at a high definition capture file. You can encode a selected portion of the timeline, using the home and end keys to select in & out points. This is good for making short test videos. Save as AVI...
UPDATE 18-Jan-2013: psd save to MP4 instead of to AVI (seems to be more YouTube friendly) VirtualDub: psd save direct to MP4 (Fraps to YouTube) (this is an advanced technique)​ OK, set the audio compression: You'll see a list of encoders installed on your machine; most are either low quality, or restricted to use by a particular program. There's two ways to go with audio compression: AC3 , stereo of course, constant bit rate (important), and about 96-128 kbps, more or less. Uncompressed PCM makes your files maybe 10-15% bigger, but it's much more compatible with all players and video editors. Recommended for archive & intermediate files - see here . (explained a little more clearly @ post #23 ) Now the video compression: Choose H.264 - normally x264vfw unless you already have a different flavor installed. psd Make sure Force keyframes is not checked. Here are the H.264 settings I currently use for Fraps to YouTube: psd
[ EDIT - moved all H.264 settings to this post to avoid duplication; in short: get x264vfw . Mode=Constant Ratefactor, Ratefactor=19. Uncompressed audio]​ And I should add: check "VirtualDub hack" in your x264vfw options. (...continued in next post) last updated Jan 11, 2014
OK now we want to add some filters to enhance the video a bit: (note full processing mode has to be checked to use filters) At first we have an empty filter list; hit the Add button: The first one we'll add is the levels filter: We boost the white levels a bit to help the video "pop". I usually set Input "white" to 240 as shown, maybe 220 for a dark source. For really dark scenes you might want to move the middle triangle ( gamma ) to the left a bit - not too much [1.2 to 1.3]! Hit "Show Preview" to see the effect as you make adjustments: Caution - check to make sure this actually improves psd your video . This has the potential to show slight banding on smooth color contours (like a clear blue sky). If it's objectionable, don't use it. For more on color correction of dark videos see this post . [Also this post .] Note you can quickly turn the filter on & off without removing it permanently - just uncheck the check box for that filter in the filter list. Next we add the HSV filter, and use it to boost saturation (110% - 120%); this helps overcome losses though the encoding process, and through the online re-encoding process. For the same reason, we need to add the sharpen filter, set to about 10-15% (no picture; use the preview windows and just add a little sharpness - the video should look just a little too sharp). UPDATE - add the "alias format" filter: Color space ="Rec. 709 (HD)". Component range ="No change". This fixes a slight desaturation of red colors. If you want to upsize say, a 1280x720 video to 1920x1080, add a resize filter. Set "Filter psd mode" to "Lanczos3" for maximum shar