It will load as fast as

1) the user can download it

and

2) fast as the server that is hosting the video is running.

YouTube (youtube.com) uses a flash format, which is what I would recommend to you for running the video efficiently. Everyone's got a flash player!