I've just converted a video to FLV using Avidemux 2.5.2 on Ubuntu. While I realize that your question is about Avidemux on Windows, I think that they should work pretty similarly on both platforms. The key things were:
- Set the video codec to FLV1 (lavc)
- Set the audio codec to MP3
- Set the format to FLV