This question describes the general software and hardware architecture that makes WordPress development possible. Our goal isn't to make you into a systems administrator, but we do want to make you comfortable with the core infrastucture in and around a WordPress site.
The Four Languages You Must Know To Understand WordPress
Understanding "Server-Side" and "Client-Side" in WordPress
A WordPress LAMP? An Introduction to WordPress Infrastructure
...