The "src" attribute is used in HTML tags such as <img> and <script> to specify the source location (URL) of an external file, such as an image or a JavaScript file. On the other hand, the "href" attribute is used in tags like <a> and <link> to specify the target URL of a hyperlink or the location of an external CSS file.