marinone94
/

xls-r-300m-sv-robust

Automatic Speech Recognition

mozilla-foundation/common_voice_9_0

generated_from_trainer

Inference Endpoints

Model card Files Files and versions Community

xls-r-300m-sv-robust / kenlm /util /parallel_read.hh

marinone94's picture

Training in progress, epoch 0

1ce325b almost 2 years ago

raw history blame contribute delete

No virus

461 Bytes

	#ifndef UTIL_PARALLEL_READ__
	#define UTIL_PARALLEL_READ__

	/* Read pieces of a file in parallel. This has a very specific use case:
	* reading files from Lustre is CPU bound so multiple threads actually
	* increases throughput. Speed matters when an LM takes a terabyte.
	*/

	#include <cstddef>
	#include <stdint.h>

	namespace util {
	void ParallelRead(int fd, void *to, std::size_t amount, uint64_t offset);
	} // namespace util

	#endif // UTIL_PARALLEL_READ__