A method, comprising: receiving encoded video information in multiple video streams each having different video layers with different levels of spatial resolution, temporal resolution and quality for rendering decoded video information in display frames to create a visual composition for a conference call, wherein the visual composition includes multiple display objects, each display object comprising a display window, each displaying video information for different participants in a conference call; determining a total input bit rate for the multiple display objects; allocating a display object bit rate to each of the multiple display objects where a total display object bit rate for all display objects is equal to or less than said total input bit rate; wherein the display object bit rate is allocated to a display object of the multiple display objects based on one or more of: display object size, display object location and an instantaneous channel capacity for a given communications link and the display object bit rate allocated to each of the display objects is dynamically varied based on a change in one of the following conditions: changes in display object size, changes in an amount of motion for video information in a given display object, change in status; and decoding video information from said different video layers for said display objects in accordance with said allocations; wherein each video stream has different video layers including a base layer having a first level of spatial resolution and a first level of temporal resolution, and an enhancement layer increasing said first level of spatial resolution or said first level of temporal resolution; wherein a number of video decoders selectively decode digital video information from a given video layer of the encoded video streams; wherein one video decoder decodes the base layer and another video decoder decodes at least one enhancement layer; rendering said decoded video information in each display frame to create a visual composition for a conference call; the method further comprising adaptively scheduling the transmission of the video layers in time on behalf of a sending client terminal, comprising first transmitting lower video layers and gradually transmitting additional layers to improve the video quality overtime. receiving encoded video information in multiple video streams each having different video layers with different levels of spatial resolution, temporal resolution and quality for rendering decoded video information in display frames to create a visual composition for a conference call, wherein the visual composition includes multiple display objects, each display object comprising a display window, each displaying video information for different participants in a conference call; determining a total input bit rate for the multiple display objects; allocating a display object bit rate to each of the multiple display objects where a total display object bit rate for all display objects is equal to or less than said total input bit rate; wherein the display object bit rate is allocated to a display object of the multiple display objects based on one or more of: display object size, display object location and an instantaneous channel capacity for a given communications link and the display object bit rate allocated to each of the display objects is dynamically varied based on a change in one of the following conditions: changes in display object size, changes in an amount of motion for video information in a given display object, change in status; and decoding video information from said different video layers for said display objects in accordance with said allocations; wherein each video stream has different video layers including a base layer having a first level of spatial resolution and a first level of temporal resolution, and an enhancement layer increasing said first level of spatial resolution or said first level of temporal resolution; wherein a number of video decoders selectively decode digital video information from a given video layer of the encoded video streams; wherein one video decoder decodes the base layer and another video decoder decodes at least one enhancement layer; rendering said decoded video information in each display frame to create a visual composition for a conference call; the method further comprising adaptively scheduling the transmission of the video layers in time on behalf of a sending client terminal, comprising first transmitting lower video layers and gradually transmitting additional layers to improve the video quality overtime.