title: Parallel processing videos in very large digital libraries

authors: Thompson, John

subjects: DSpace

abstract: Nowhere are the 'growing pains' of Very Large-scale Digital Libraries more pronounced than in collections containing multimedia data. Not only do such collections contain large numbers of items, but they also push the boundaries of scale in terms of storage space and processing expense. In this paper we explore how applying parallel processing open-source libraries and techniques-previously developed for and applied to textual content-can be of benefit to multimedia digital libraries. We provide a real-world use case of ingesting video into the ReplayMe! system, an extension of the Greenstone digital library software, that simultaneously records and ingests all of the free-to-air television channels available in New Zealand. Current ingest of video in ReplayMe! is intentionally light due to processing time constraints on the single processor architecture it was developed on. The work reported here investigates how this system can be scaled up to include the conversion of the broadcast video transport format to a suitable a streaming format (MP4) and to automatically extract content analysis based keyframes, while still performing within real-time. By applying parallel processing, and utilizing a cluster of sixteen desktop computers, the paper shows how this processing time can be significantly reduced compared to the equivalent computation if conducted serially. We then generalize the work, and show how the same basic techniques can be applied to other common digital library software such as DSpace to provide similar advantages when dealing with processor intensive content.

text: Parallel processing videos in very large digital libraries Nowhere are the 'growing pains' of Very Large-scale Digital Libraries more pronounced than in collections containing multimedia data. Not only do such collections contain large numbers of items, but they also push the boundaries of scale in terms of storage space and processing expense. In this paper we explore how applying parallel processing open-source libraries and techniques-previously developed for and applied to textual content-can be of benefit to multimedia digital libraries. We provide a real-world use case of ingesting video into the ReplayMe! system, an extension of the Greenstone digital library software, that simultaneously records and ingests all of the free-to-air television channels available in New Zealand. Current ingest of video in ReplayMe! is intentionally light due to processing time constraints on the single processor architecture it was developed on. The work reported here investigates how this system can be scaled up to include the conversion of the broadcast video transport format to a suitable a streaming format (MP4) and to automatically extract content analysis based keyframes, while still performing within real-time. By applying parallel processing, and utilizing a cluster of sixteen desktop computers, the paper shows how this processing time can be significantly reduced compared to the equivalent computation if conducted serially. We then generalize the work, and show how the same basic techniques can be applied to other common digital library software such as DSpace to provide similar advantages when dealing with processor intensive content.

year: 2012

title: Pasture burning post irrigation of dairy factory effluent at Edgecumbe, New Zealand

authors: Patterson, Kelli Beth

abstract: Pasture “burning” occurs when pasture turns yellow and dies back following irrigation of high strength effluent from the Fonterra Edgecumbe dairy factory. Pasture burning generally occurs intermittently during spring and continues into early summer. The objectives of my thesis are to review literature related to pasture burning and relate literature to potential causes; monitor pasture burning events and activities at Fonterra Edgecumbe dairy factory to endeavour to find potential causes of pasture burning and undertake an experiment(s) to determine the concentration at which components of the effluent cause pasture burning. 

Preliminary observations and a literature review identified multiple potential causes of pasture burning including effluent with high or low pH, high temperature, low osmotic potential/high osmolality as well as UV-radiation damage, excess nutrients, and salt build up in the soil and plant leaves. The weather at the time of irrigation and daily changes in the effluent composition may influence the severity of burning. It is likely that pasture burning is caused by a combination of effects.

The osmolality measures the concentration of a solution. Osmolality was chosen as a measure of pasture burning as the osmolality measure the solute concentration in a solution. Fresh clover (400 - 500 mmol/kg) and ryegrass (500 - 600 mmol/kg) had a similar mean symplasmic osmolality to burnt clover and ryegrass. The high strength effluent had a lower mean osmolality (217 mmol/kg) compared to fresh and burnt clover and ryegrass. If there are spikes in the concentration of effluent, the osmolality of the effluent may exceed that of the pasture causing reverse osmosis and the water in the plant cells to move out of the leaf causing dehydration. 

A pilot trial to determine if there was a relationship between osmolality and pasture burning was undertaken. Effluent was spiked with KCl and lactose solution to increase the osmolality. The pilot trial showed that as the osmolality of the effluent increased, clover and ryegrass burning increased. A main experiment was then designed to determine the cut off point for the osmolality of the effluent to prevent pasture burning. 

The main experiment was also designed to determine if younger growth was more susceptible to pasture burning. One block had progibb and urea applied to enhance the growth of the pasture.  The main experiment however, was unable to determine if new growth was more susceptible to pasture burning as the weather and nutrient content of the soil was optimal for pasture growth in both blocks.

In the pilot trial, there was a positive correlation (R2 > 0.5) between ryegrass and osmolality, pH, electrical conductivity, total magnesium, sulphate, total sulphur, total sodium, total nitrogen, dissolved reactive phosphorus, total kjeldahl nitrogen and the sodium absorption ratio.

In the main experiment, there was a positive correlation (R2 > 0.5) between clover burning and electrical conductivity, exchangeable sodium percentage, total potassium and chloride. However, there was no strong correlation between ryegrass burning and any of the effluent properties. 
When the pilot trial and main experiment results were combined, there was a positive correlation (R2 > 0.5) between clover burning and electrical conductivity, chloride, total potassium and osmolality. 

My results suggest that the effluent osmolality should not exceed 450 mmol/kg and the electrical conductivity should not exceed 1500 mS/m to prevent strong to very strong pasture burning. Effluent that exceeds either 450 mmol/kg and/or 1500 mS/m should be recirculated through the holding tanks to reduce the concentration of the “spike”.
Clover was more susceptible to severe pasture burning than ryegrass. Further research into pasture burning is required to isolate and better understand the exact cause.

text: Pasture burning post irrigation of dairy factory effluent at Edgecumbe, New Zealand Pasture “burning” occurs when pasture turns yellow and dies back following irrigation of high strength effluent from the Fonterra Edgecumbe dairy factory. Pasture burning generally occurs intermittently during spring and continues into early summer. The objectives of my thesis are to review literature related to pasture burning and relate literature to potential causes; monitor pasture burning events and activities at Fonterra Edgecumbe dairy factory to endeavour to find potential causes of pasture burning and undertake an experiment(s) to determine the concentration at which components of the effluent cause pasture burning. 

Preliminary observations and a literature review identified multiple potential causes of pasture burning including effluent with high or low pH, high temperature, low osmotic potential/high osmolality as well as UV-radiation damage, excess nutrients, and salt build up in the soil and plant leaves. The weather at the time of irrigation and daily changes in the effluent composition may influence the severity of burning. It is likely that pasture burning is caused by a combination of effects.

The osmolality measures the concentration of a solution. Osmolality was chosen as a measure of pasture burning as the osmolality measure the solute concentration in a solution. Fresh clover (400 - 500 mmol/kg) and ryegrass (500 - 600 mmol/kg) had a similar mean symplasmic osmolality to burnt clover and ryegrass. The high strength effluent had a lower mean osmolality (217 mmol/kg) compared to fresh and burnt clover and ryegrass. If there are spikes in the concentration of effluent, the osmolality of the effluent may exceed that of the pasture causing reverse osmosis and the water in the plant cells to move out of the leaf causing dehydration. 

A pilot trial to determine if there was a relationship between osmolality and pasture burning was undertaken. Effluent was spiked with KCl and lactose solution to increase the osmolality. The pilot trial showed that as the osmolality of the effluent increased, clover and ryegrass burning increased. A main experiment was then designed to determine the cut off point for the osmolality of the effluent to prevent pasture burning. 

The main experiment was also designed to determine if younger growth was more susceptible to pasture burning. One block had progibb and urea applied to enhance the growth of the pasture.  The main experiment however, was unable to determine if new growth was more susceptible to pasture burning as the weather and nutrient content of the soil was optimal for pasture growth in both blocks.

In the pilot trial, there was a positive correlation (R2 > 0.5) between ryegrass and osmolality, pH, electrical conductivity, total magnesium, sulphate, total sulphur, total sodium, total nitrogen, dissolved reactive phosphorus, total kjeldahl nitrogen and the sodium absorption ratio.

In the main experiment, there was a positive correlation (R2 > 0.5) between clover burning and electrical conductivity, exchangeable sodium percentage, total potassium and chloride. However, there was no strong correlation between ryegrass burning and any of the effluent properties. 
When the pilot trial and main experiment results were combined, there was a positive correlation (R2 > 0.5) between clover burning and electrical conductivity, chloride, total potassium and osmolality. 

My results suggest that the effluent osmolality should not exceed 450 mmol/kg and the electrical conductivity should not exceed 1500 mS/m to prevent strong to very strong pasture burning. Effluent that exceeds either 450 mmol/kg and/or 1500 mS/m should be recirculated through the holding tanks to reduce the concentration of the “spike”.
Clover was more susceptible to severe pasture burning than ryegrass. Further research into pasture burning is required to isolate and better understand the exact cause.

year: 2017

title: E ia, e ia

authors: Maxwell, Te Kahautu

abstract: Poi, Lyrics composed by Te Kahautu Maxwell, Musical score composed by Te Whānau Mitai. Performed by Ōpōtiki Mai Tawhiti (Kapa Haka group) (3mins)

Waiata ā Tira: Aroha
Whakaeke: Pinepine Te Kura, Hau Te Kura
Mōteatea: Te Ao o Te Pārerā
Waiata ā Ringa: E pā to reo, Te Matatini, Herewini Parata
Poi: E ia e ia
Haka: Te Kōtiritiri, Te Kōtaratara
Whakawātea: Ōranga Tōiti, tōnui kōrero

text: E ia, e ia Poi, Lyrics composed by Te Kahautu Maxwell, Musical score composed by Te Whānau Mitai. Performed by Ōpōtiki Mai Tawhiti (Kapa Haka group) (3mins)

Waiata ā Tira: Aroha
Whakaeke: Pinepine Te Kura, Hau Te Kura
Mōteatea: Te Ao o Te Pārerā
Waiata ā Ringa: E pā to reo, Te Matatini, Herewini Parata
Poi: E ia e ia
Haka: Te Kōtiritiri, Te Kōtaratara
Whakawātea: Ōranga Tōiti, tōnui kōrero

year: 2023-02-22