High-level language based instruction sets, exemplified by the Burroughs B5000, brought advancements in instruction sets by incorporating features to support high-level languages. These architectures provided efficient memory management, garbage collection, and automatic parameter passing, making it easier to write and execute programs in high-level languages.