This is so true. The starting developer will feel an immediate response, without (typically) first having to install/configure the webserver, compile code, setup deployment scripts etc.

PHP is definitely not a good language to start programming at first (for that I'd recommend Scheme, ala SICP) but it's definitely a great one for a My First Website project.