# Patent

## Title
Process isolation using protection domains

## Abstract

A first plurality of operating system processes is assigned to a first protection domain, and a second plurality of operating system processes is assigned to a second protection domain. One or more hardware protection mechanisms are used to prevent the first plurality of operating system processes from accessing the memory space of the second plurality of operating system processes, and also to prevent the second plurality of operating system processes from accessing the memory space of the first plurality of operating system processes.

## Background
RELATED APPLICATIONS
This application is a continuation-in-part of U.S. patent application Ser. No. 11/005,562, which was filed on Dec. 6, 2004 and is titled “Operating-System Process Construction”, which is hereby incorporated by reference herein.


BACKGROUND
Modern computers are controlled by an operating system that executes computer programs as processes. Processes include a memory space as well as a set of instructions that can be executed by the processor of a computer. In order to enforce security and ensure that processes do not interfere with one another, hardware protection mechanisms such as privilege levels and virtual memory have been employed to isolate processes from one another.
Unfortunately, hardware protection mechanisms can be very costly in terms of execution time, reducing the performance of the processes. Therefore, it would be beneficial to have a way to maintain isolation of processes but also reduce the performance burden imposed by hardware protection mechanisms.
SUMMARY
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In accordance with certain aspects, a first plurality of operating system processes is assigned to a first protection domain, and a second plurality of operating system processes is assigned to a second protection domain. One or more hardware protection mechanisms are used to prevent the first plurality of operating system processes from accessing the memory space of the second plurality of operating system processes, and also to prevent the second plurality of operating system processes from accessing the memory space of the first plurality of operating system processes.



BRIEF DESCRIPTION OF THE DRAWINGS
The same numbers are used throughout the drawings to reference like features.
FIG. 1 illustrates an example computing device.
FIG. 2 illustrates an example process for isolating operating system processes.
FIG. 3 illustrates an example of the usage of hardware protection.
FIG. 4 illustrates an example of a general computing device that can be used to implement the process isolation using protection domains discussed herein.



DETAILED DESCRIPTION
FIG. 1 illustrates an example computing device 100. Computing device 100 executes operating system processes grouped into one or more protection domains. Each protection domain can include one or more operating system processes. As illustrated in FIG. 1, computing device 100 includes one or more protection domains 104(1), . . . , 104(2). Protection domain 104(1) includes one or more processes 106(1), . . . , 106(2), and protection domain 104(2) includes one or more processes 108(1), . . . , 108(2).
One protection domain, shown as protection domain 104(1) in FIG. 1, includes an operating system kernel 102 that controls the execution of the operating system processes 106, 108 on device 100. One or more additional operating system processes can also be used to provide, in conjunction with kernel 102, operating system functionality for device 100. The protection domain 104(1) that includes kernel 102 can also be a kernel domain, as discussed in more detail below.
Each operating system process 106, 108, also referred to herein as a process, includes a memory space and a set of processor executable instructions. The memory space refers to one or more portions of memory that the instructions of the processor are to be stored in, run in, and are to access for data storage. These portions of memory are typically assigned by operating system kernel 102 to operating system processes 106, 108 as memory pages. The size of a memory page can vary based on operating system kernel 102 and the hardware (e.g., the processor) of computing device 100. In certain embodiments, each operating system process 106, 108 is a software isolated process (SIP), as discussed in more detail below.
Operating system processes 106, 108 can be controlled and managed individually by operating system kernel 102. Various information regarding the execution of each of the processes 106, 108 individually can be maintained by operating system kernel 102, such as the amount of processor time, memory, or other resource(s) that is used by the process; whether the process accessed a network, particular file(s), or other resource(s); the date and time when execution of the process began; and so forth. The operating system also maintains control over the individual processes and can terminate execution of a particular process whenever desired. The operating system can use any factors in determining to terminate execution of a particular process, such as if the operating system determines that the process is using too much of a particular resource, if the operating system believes that the process is malfunctioning, if the operating system believes the process has been running for too long, on user input, and so forth.
It should be noted that all of the operating system processes 106, 108 can be associated with the same user(s) or with different users, even though processes 106 are included in a different protection domain than processes 108. The process isolation discussed herein refers to isolating the processes from one another without regard for who the owner(s) of the process(es) are and without regard for any access control list constraints or other privilege restrictions of users in accessing a particular program, and so forth.
Operating system kernel 102 can employ both software protection and hardware protection mechanisms to isolate processes. Isolation of processes refers to allowing processes to access their own memory space but preventing them from accessing the memory space of other processes. This isolation provides security by preventing processes from interfering with the operation of other processes. This isolation also helps ensure that processes do not interfere with one another; the programmers that develop the programs that are run as processes can typically develop their programs without concern for the other processes that may be executing on the computing device at the same time.
Software protection refers to employing software mechanisms to isolate processes. In certain embodiments, the software protection refers to placing restrictions on the language that programs are written in, placing restrictions on the manner in which programs are compiled into executable instructions, and placing restrictions on the runtime environment in which the instructions are executed. All of these restrictions, when combined, result in processes that execute in their own memory space but do not access the memory space of other processes.
Hardware protection refers to employing features of the computing device, typically the processor of the computing device, to isolate processes. Where software protection relies on the manner in which the programs are written, compiled, and executed to ensure isolation, the hardware protection isolates processes even if the programs are not written, compiled, and executed to ensure isolation. In certain embodiments, the hardware protection refers to employing virtual memory and privilege level features of the processor executing the processes as discussed in more detail below.
FIG. 2 illustrates an example process 200 for isolating operating system processes. Process 200 can be carried out, for example, by operating system kernel 102 of FIG. 1, and may be implemented in software, firmware, hardware, or combinations thereof.
Initially, a request to execute one or more operating system processes is received (act 202). Requests to execute processes can be received, for example, as a result of a user input (e.g., user-selection of a program to be executed), as a result of a request from another operating system process that is executing, as a result of a request originating from part of the operating system, and so forth. Software protection can be used to isolate each operating system process from the other operating system processes (act 204). Software protection allows each operating system process, regardless of which protection domain it is part of, to be isolated from the other processes executing on the computing device. This isolation includes isolation from the other processes in its own protection domain as well as isolation from the processes in the other protection domains. Any of a variety of different software protection mechanisms can be used to implement the software protection in act 204. In certain embodiments, the software protection is implemented using software isolated processes (SIPs), as discussed in more detail below.
The operating system processes are grouped into different protection domains (act 206). Multiple protection domains can be used by the operating system, and multiple operating system processes can be included in each protection domain. The operating system can use any of a variety of different factors in determining which protection domain a particular operating system process is to be assigned to. For example, the user of the computing device that has requested execution of the process may also request a particular protection domain. The user may explicitly identify a particular protection domain, such as by requesting that the process execute in protection domain number 1. Alternatively, the user may implicitly identify a particular protection domain, such as by requesting that the process execute in the same protection domain as another executing process, in the same protection domain as other processes from the same manufacturer, and so on.
By way of another example, the operating system may have specific rules that specify which protection domains should include which operating system processes. Default rules can be included in the operating system, and may be altered by a system administrator or other user. Examples of such rules include: all processes from a particular manufacturer are to be included in the same protection domain, but that is a different protection domain than the processes from other manufacturers are included in; all new processes (e.g., from programs installed within the last month) are to be run in a separate protection domain; and so forth.
Situations can arise where a protection domain into which an operating system process(es) is to be grouped in act 206 does not yet exist. New protection domains are created for operating system processes as needed (act 208). Thus, whenever an operating system process is to be grouped into a protection domain that has not yet been created, that protection domain is created in act 208.
Additionally, hardware protection is used to isolate operating system processes in protection domains from other protection domains (act 210). This hardware protection in act 210 is in addition to the software protection in act 204. The hardware protection in act 210 operates as backup protection to the software protection in act 204. If there is a failure in or breach of the software protection, then operating system processes in different protection domains are still isolated from one another using the hardware protection in act 210.
Oftentimes, all the operating system processes executing on a device are protected using both software protection and hardware protection. However, situations can arise where only software protection or only hardware protection is used for at least some of the operating system processes. For example, a particular operating system process may be protected using hardware protection but not software protection, even though all the other operating system processes are being protected using both hardware protection and software protection.
Process 200 is performed at runtime. Typically, after receiving the request in act 202 to execute a process, the determination of which protection domain(s) to assign the process to is made prior to beginning execution of the process. Additionally, these determinations can change over time. For example, a process may be included in one protection domain one time it is executed, and, after execution has terminated, the process may be included in a different protection domain when it is subsequently executed regardless of whether the computing device on which the process is executing has been reset or restarted.
As discussed above, software protection refers to employing software mechanisms to isolate processes. In certain embodiments, the software protection is employed using a mechanism referred to as software isolated processes (SIPs). Additional information regarding SIPs and their construction can be found in the parent application (U.S. patent application Ser. No. 11/005,562), as well as U.S. patent application Ser. No. 11/007,655, which was filed on Dec. 7, 2004 and is titled “Inter-Process Communications Employing Bi-directional Message Conduits”, which is hereby incorporated by reference herein, and U.S. patent application Ser. No. 11/007,808, which was filed on Dec. 7, 2004 and is titled “Self-Describing Artifacts and Application Abstractions”, and which is also hereby incorporated by reference herein.
Software isolated processes make use of software verification, rather than hardware protection, to isolate processes. Software isolated processes rely on verifying safe behavior of code to prevent it from accessing another process's (or the kernel's) instructions or data. A verifiably safe program or process is one that can only access data that it allocated or was passed, and it cannot construct or corrupt a memory reference. Object allocation creates new references and occurs within a trusted runtime, which logically is an extension of the operating system kernel.
Software isolation makes use of two properties: type and memory safety. Type safety ensures that the only operations applied to a value (or area of memory containing a value) are those defined for instances of its type. Memory safety ensures the validity of memory references by preventing null pointer references, references outside an array's bounds, or references to deallocated memory. These properties can be partially verified by a compiler, but in some circumstances, such as dynamic array access, require runtime tests.
All untrusted code that runs in a SIP must be verifiably safe. The SIP may also contain trusted, unverified code that cannot be expressed in a safe language, for example, parts of the language runtime, a memory allocator, or an accessor for memory-mapped I/O. The correctness and safety of this type of code is verified by other means. A SIP is a closed object space that resides on a collection of memory pages exclusively owned by a process. An object space is the complete collection of objects reachable by a process at a point during its execution.
Software isolated processes ensure that two processes' objects spaces and memory spaces are always disjoint. Since the code in the processes is safe, the only way in which one process could obtain a reference to an object of another process is to be passed it. Software isolated processes prevent crossprocess references by not providing shared memory and by using the language type system to prevent a process from sending an object reference through the interprocess communication mechanism.
With software isolated processes, all interprocess communication occurs through messages passing across channels, which allows two processes to exchange data through an area of memory called the exchange heap. Messages in this heap are structs, not objects—they do not contain methods and cannot contain object references. Messages, however, can contain references to exchange heap data, so it is possible to send structured data between processes. However, an object reference cannot be embedded in a message or sent between processes. Moreover, the system maintains the invariant that there exists at most one pointer to an item in the exchange heap. When a process sends a message, it loses its reference to the message, which is transferred to the receiving process (analogous to sending a letter by postal mail). Therefore, processes cannot use this heap as shared memory and messages can be exchanged through pointer passing, not copying.
Hardware protection, as discussed above, refers to employing features of the computing device, typically the processor of the computing device, to isolate processes. In certain embodiments, the hardware protection refers to employing virtual memory and privilege level features of the processor of the computing device executing the processes (e.g., a processor of computing device 100 of FIG. 1).
FIG. 3 illustrates an example of the usage of hardware protection. In FIG. 3, virtual memory is used as a hardware protection mechanism. With virtual memory, virtual address spaces are assigned to each protection domain. The operating system maintains a mapping of virtual addresses to physical memory addresses for each protection domain, and uses this mapping when an operating system process of the protection domain is executing. The operating system processes use the virtual address space, unaware of the actual physical memory space that it corresponds to. In this use of virtual memory, the operating system takes care that, except for kernel memory, each given physical memory page is used by at most one virtual address space.
In the example of FIG. 3, two protection domains 302 and 304 are illustrated. Protection domain 302 includes an operating system process 312 that includes one or more memory pages 314. The memory pages 314 are also referred to as the memory space, or the memory of process 312. Protection domain 302 also includes an operating system process 316 that includes one or more memory pages 318. The memory pages 318 are also referred to as the memory space, or the memory of process 316.
The operating system also maintains a page table 320 that identifies the memory pages that are accessible by protection domain 302. Page table 320 is used by the processor during execution of the operating system and the operating system processes when requests are made to access memory. If a request is made by operating system process 312 or 316 to access a memory location that is not on a memory page identified in page table 320, then the processor will not permit the memory location to be accessed. If a memory location appears in table 320, the operating system ensures that it does not appear in any other table (except for kernel memory), ensuring that the memory used by protection domain 302 is not accessible by processes in any other protection domain.
Similarly, protection domain 304 includes an operating system process 332 that includes one or more memory pages 334. The memory pages 334 are also referred to as the memory space, or the memory of process 332. Protection domain 304 also includes an operating system process 336 that includes one or more memory pages 338. The memory pages 338 are also referred to as the memory space, or the memory of process 336.
The operating system also maintains a page table 340 that identifies the memory pages that are accessible by protection domain 304. Page table 340 is used by the processor during execution of the operating system and the operating system processes when requests are made to access memory. If a request is made by operating system process 332 or 336 to access a memory location that is not on a memory page identified in page table 340, then the processor will not permit the memory location to be accessed. If a memory location appears in table 340, the operating system ensures that it does not appear in any other table (except for kernel memory), ensuring that the memory used by protection domain 304 is not accessible by processes in any other protection domain.
Typically, at any given time, the processor (or a core of a processor in situations where the processor includes multiple cores) executes only one process at a time. When the processor switches to execute a different process, the processor loads the page table for the protection domain that the new process is assigned to. If the new process is in the same protection domain as the previously running process, then the same page table can be used and need not be re-loaded.
Thus, the use of virtual memory allows operating system processes to be isolated using hardware. The processor executing the operating system processes prohibits each operating system process from accessing any memory locations that are not assigned to the same protection domain as the operating system process. The operating system ensures that, except for kernel memory, each memory location is assigned to at most one protection domain.
The hardware protection can also make use of privilege level features of the processor of the computing device executing the processes. The privilege level features of the processor refer to features that allow different processes to be executed at different privilege levels. These different levels may be referred to as different rings (e.g., Ring 0 and Ring 3 in x86 architecture processors), supervisor mode and user mode, and so forth. Regardless of the nomenclature used, the privilege features allow certain processes to be executed at a more-privileged level (e.g., Ring 0 or supervisor mode), and others to be executed at a less-privileged level (e.g., Ring 3 or user mode).
Processes executing at the less-privileged level are not permitted to directly access any code or methods of the processes running at the more-privileged level. The processes executing at the less-privileged level are prohibited by the processor from accessing any of the memory pages of the processes running at the more-privileged levels. Rather, the processor includes instructions that can be invoked by a less-privileged level process to cause the processor to switch to running the more-privileged process in order to allow the code desired by the less-privileged process to be executed.
The operating system kernel executes at the more-privileged level. The operating system maintains an attribute for each protection domain that indicates whether the protection domain is a kernel domain. Multiple protection domains can be kernel domains. Kernel memory, which refers to the memory pages used by the processes executing in the kernel domain, is always mapped in the page tables used by the processor (e.g., page tables 320 and 340 of FIG. 3).
All processes in a kernel domain execute at the same processor privilege level as the kernel, whereas all other processes execute at a less-privileged level than the kernel. This allows all processes executing in the kernel domain to invoke and communicate with the kernel faster than if they were not in the kernel domain, but also allows those processes to corrupt, if they circumvent software protection, the kernel and the rest of the system as they can access the memory pages of the kernel and the virtual memory functionality of the processor. Each memory page of the kernel domain is marked (e.g., in page table 320 or page table 340 of FIG. 3) as being inaccessible to less-privileged level processes. Any processes running at the less-privileged level can invoke the proper instructions for the processor to switch to running a process in the kernel domain, but are not able to access the memory pages of the kernel domain. Additionally, the processor typically prevents any process operating at the less-privileged level from accessing the virtual memory features of the processor, thereby preventing the processes operating at the less-privileged level from circumventing the memory isolation achieved by the use of virtual memory. Thus, the processor privilege levels add an additional level of hardware protection between those processes executing at the less-privileged level and the operating system kernel.
It should be noted that, as multiple protection domains can be kernel domains, situations can arise where all processes are executing in the kernel domain. In such situations, some or all of the hardware protection features of the processor can be disabled. For example, the privilege level features of the processor can be disabled and/or the virtual memory features of the processor can be disabled.
As discussed above, messages between operating system processes are passed by exchanging data through an area of memory referred to as an exchange heap. Messages in the exchange heap do not contain methods and cannot contain object references, but can contain references to exchange heap data. So, it is possible to send data between processes using the exchange heap. At most one pointer to an item in the exchange heap exists at any one time. When a process sends a message, the process loses its reference to the message, but the receiving process obtains the reference to the message.
Each protection domain has its own exchange heap which is used by operating system processes within that protection domain to pass messages. In certain embodiments, a single kernel exchange heap exists, and all kernel domains use this single kernel exchange heap to pass messages.
As each protection domain has its own exchange heap, additional steps are taken to pass messages between operating system processes that are in different protection domains. To send a message to an operating system process in another protection domain, the sending process writes the data into a structure in the exchange heap of its protection domain. The sending process then invokes the kernel to request that this data and any other data in the exchange heap that it references be marshaled and copied to the target protection domain. The kernel marshals the data by first copying the data into the kernel exchange heap and deallocating the memory from the exchange heap of the protection domain of the sending process. The kernel then copies the data from the kernel exchange heap into a structure in the exchange heap of the target protection domain.
In certain embodiments, the operating system maintains a record of the memory blocks that are allocated for each exchange heap. This record is maintained separately from the actual data of the exchange heap blocks. To maintain the integrity of this record, only processes in the kernel domain can write data to this record.
In certain embodiments, such as current x86 architecture processors, the operating system specifies virtual to physical mapping with a tree of mapping descriptors rooted at a processor control register. This control register can only be accessed by more-privileged processes. The structure of the tree is dictated by the processor and can vary according to the memory management unit (MMU) features of the processor that are enabled. The mapping descriptors are arranged in a three-tiered tree. The root node contains four, 64-bit entries, each spanning 1 GB of virtual memory. A second-tier node occupies one 4 KB memory page and contains 512 64-bit entries, each of which spans 2 MB of virtual memory. Entries in the root and second-tier nodes contain the physical address of their child node. A leaf node contains 512 64-bit entries, each of which is the physical address of an individual 4 KB memory page. Every entry also contains a variety of control bits.
When virtual memory is used, an address manipulated by a process is virtual; at execution time, it is translated to a physical RAM address. When executing any instruction that references memory, the processor translates a virtual address by using its most significant 2 bits as an index into the root node of memory-mapping descriptor tree. The selected entry points to second-tier node, which is indexed by the 3rd through 12th most significant bits of the virtual address. The next 9 bits are used as an index into a leaf node. The least-significant 12 bits of the virtual address are an offset into the 4 KB memory page indicated the leaf node.
Because a complete mapping tree would occupy 8 MB of physical RAM, a control bit in every entry indicates the entry's validity. When this bit is cleared, the entry indicates that no physical memory is mapped to its corresponding range of virtual memory. Accessing memory in an unmapped range raises a processor page fault exception. Performing this translation process at every memory reference is impractical, so a Translation Lookaside Buffer (TLB) caches virtual-to-physical memory mappings. On current x86 processors, the operating system explicitly invalidates TLB entries when it updates memory mappings, as the TLB is not automatically updated or flushed. Reloading the memory-mapping control register (which specifies the root memory-mapping descriptor node) implicitly invalidates the entire TLB.
FIG. 4 illustrates an example of a general computing device 400 that can be used to implement the process isolation using protection domains discussed herein. Computing device 400 can be a device 100 of FIG. 1. Computing device 400 is only one example of a computing device and is not intended to suggest any limitation as to the scope of use or functionality of the computing device and network architectures. Neither should computing device 400 be interpreted as having any requirement regarding the inclusion (or exclusion) of any components or the coupling or combination of components illustrated in the example computing device 400.
Computing device 400 is a general-purpose computing device that can include, but is not limited to, one or more processors or processing units 404, a system memory 406, and a bus 402 that couples various system components including the processor 404 to the system memory 406.
Bus 402 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus.
System memory 406 includes computer readable media in the form of volatile memory, such as random access memory (RAM), and/or non-volatile memory, such as read only memory (ROM) 412.
Computing device 400 may also include other removable/non-removable, volatile/non-volatile computer storage device 408. By way of example, storage device 408 may be one or more of a hard disk drive for reading from and writing to a non-removable, non-volatile magnetic media, a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a “floppy disk”), an optical disk drive for reading from and/or writing to a removable, non-volatile optical disk such as a CD, DVD, or other optical media, a flash memory device, and so forth. These storage device(s) and their associated computer-readable media provide storage of computer readable instructions, data structures, program modules, and/or other data for computing device 400.
User commands and other information can be entered into computing device 400 via one or more input/output (I/O) devices 410, such as a keyboard, a pointing device (e.g., a “mouse”), a microphone, a joystick, a game pad, a satellite dish, a serial port, a universal serial bus (USB), a IEEE 1394 bus, a scanner, a network interface or adapter, a modem, and so forth. Information and data can also be output by computing device 400 via one or more I/O devices 410, such as a monitor, a printer, a network interface or adapter, a modem, a speaker, and so forth.
An implementation of the process isolation using protection domains described herein may be described in the general context of processor-executable instructions or computer-executable instructions, such as program modules, executed by one or more computing devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.
An implementation of the process isolation using protection domains may be stored on or transmitted across some form of computer readable media. Computer readable media or processor-readable media can be any available media that can be accessed by a computer. By way of example, and not limitation, computer readable media or processor readable media may comprise “computer storage media” and “communications media.”
“Computer storage media” include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.
“Communication media” typically embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier wave or other transport mechanism. Communication media also include any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer readable media.
Alternatively, all or portions of these modules and techniques may be implemented in hardware or a combination of hardware, software, and/or firmware. For example, one or more application specific integrated circuits (ASICs) or programmable logic devices (PLDs) could be designed or programmed to implement one or more portions of the framework.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

## Claims

1. A computer-implemented method of isolating a plurality of operating system processes on a particular processor, the method comprising:
using software protection for at least two of the operating system processes to prevent each of the at least two operating system processes from accessing memory assigned to the other of the at least two operating system processes and to other processes of the plurality of operating system processes;
grouping the plurality of operating system processes into a plurality of protection domains, each of the at least two operating system processes being grouped into a different protection domain; and
using hardware protection to prevent one of the at least two operating system processes from accessing memory assigned to another operating system process belonging to a different protection domain from the one of the at least two operating system processes, the hardware protection operating as backup protection to the software protection.

2. A method as recited in claim 1, the hardware protection comprising assigning one of the protection domains a more-privileged processor privilege level than is assigned to other protection domains that include one or more of other processes of the plurality of operating system processes, wherein a processor executing the plurality of operating system processes prevents the one or more of the other processes from accessing memory assigned to the one of the at least two operating system processes in the protection domain, and further prevents the one or more of the other processes from accessing virtual memory features of the processor.

3. A method as recited in claim 1, the hardware protection of the processor comprising using virtual memory to isolate one or more address spaces of the protection domains from address spaces of other protection domains.

4. A method as recited in claim 1, wherein an operating system that controls execution of the plurality of operating system processes can terminate execution of each of the plurality of operating system processes individually.

5. A method as recited in claim 1, further comprising accessing a set of rules specifying which protection domains should include which operating system processes in order to identify the processes to be grouped into the protection domains.

6. A method as recited in claim 1, the using hardware protection of the processor comprising:
identifying a first protection domain as a kernel domain;
identifying a second protection domain as the kernel domain; and
identifying a third protection domain as not the kernel domain.

7. A method as recited in claim 1, wherein one of the protection domains is a kernel domain, and wherein each of the plurality of operating system processes is a software isolated process (SIP) having software protection.

8. A method as recited in claim 1, further comprising using the hardware protection to prevent an additional process from accessing memory assigned to the plurality of operating system processes on the processor without using the software protection to prevent the additional process from accessing memory assigned to the plurality of operating system processes.

9. A method as recited in claim 1, the software protection comprising allowing the at least two operating system processes to exchange data through an area of memory belonging to neither of the at least two operating system processes and allowing only one of the at least two operating system processes to reference a data structure corresponding to a message at a time.

10. One or more computer readable media having stored thereon a plurality of instructions that, when executed by a particular processor, causes the processor to:
use software protection for at least two of the operating system processes to prevent each of the at least two operating system processes from accessing memory assigned to the other of the at least two operating system processes and to other processes of the plurality of operating system processes;
group the plurality of operating system processes into a plurality of protection domains, one of the at least two operating system processes being grouped into a first protection domain and the other of the at least two operating system processes being grouped into a second protection domain; and
use hardware protection to prevent the one of the at least two operating system processes from accessing memory assigned to another operating system process belonging to a different protection domain from the first protection domain, the hardware protection operating as backup protection to the software protection,
wherein the hardware protection includes a page table associated with the first protection domain that identifies memory pages that are accessible by the operating system processes of the first protection domain.

11. One or more computer readable media as recited in claim 10, wherein the software protection includes preventing null pointers, references outside an array's bounds, and references to deallocated memory.

12. One or more computer readable media as recited in claim 10, the hardware protection comprising assigning the first protection domain a more-privileged processor privilege level than the second protection domain, wherein a processor prevents operating system processes of the second protection domain from accessing the memory space of operating system processes of the first protection domain and further prevents the operating system processes of the second protection domain from accessing virtual memory features of the processor.

13. One or more computer readable media as recited in claim 10, the hardware protection comprising identifying the first protection domain and the second protection domain as kernel domains, identifying a third protection domain to which is assigned a third plurality of operating system processes, and identifying the third protection domain as not a kernel domain.

14. One or more computer readable media as recited in claim 10, the hardware protection comprising using virtual memory to isolate a virtual address space of the first protection domain from a virtual address space of the second protection domain.

15. One or more computer readable media as recited in claim 10, wherein which operating system processes are to be assigned to the first protection domain and which operating system processes are to be assigned to the second protection domain changes over time.

16. One or more computer readable media as recited in claim 10, wherein the page table is loaded when an operating system process of the first protection domain is executed.

17. A computing device comprising:
a processor; and
a memory, coupled to the processor, the memory storing a plurality of instructions that, when executed by the processor, cause the processor to isolate a plurality of operating system processes on the processor from each other by:
using software protection for at least two of the operating system processes to prevent each of the at least two operating system processes from accessing memory assigned to the other of the at least two operating system processes and to other processes of the plurality of operating system processes, the software protection further including preventing null pointers, references outside an array's bounds, or references to deallocated memory;
grouping the plurality of operating system processes into a plurality of protection domains, each of the at least two operating system processes being grouped into a different protection domain; and
using hardware protection to prevent one of the at least two operating system processes from accessing memory assigned to another operating system process belonging to a different protection domain from the one of the at least two operating system processes, the hardware protection operating as backup protection to the software protection,
wherein the hardware protection includes a page table associated with the protection domain having the one of the at least two processes, that protection domain identifying memory pages that are accessible by the operating system processes of that protection domain.

18. A computing device as recited in claim 17, the hardware protection comprising assigning a first protection domain a more-privileged processor privilege level than is assigned to one or more other protection domains, wherein a processor prevents one or more other processes of the other protection domains from accessing memory spaces of one or more processes in the first protection domain and further prevents the one or more other processes from accessing virtual memory features of the processor.

19. A computing device as recited in claim 17, the hardware protection comprising using virtual memory to isolate a virtual address space of a first protection domain from one or more virtual address spaces of other protection domains.

20. A computing device as recited in claim 19, the hardware protection further comprising using processor privilege levels to prevent other processes of the plurality of operating system processes from circumventing the virtual memory.