In this task, you are given a paper review. Based on the review, your job is to identify language and generate "en" if the review is in English or generate "es" if the review is in Spanish. Note that URLs in the text have been replaced with [Link].
--------
Question: RESUMEN: El trabajo relata los pasos seguidos para usar el software ERP SAP en Embonor, una productora y distribuidora de productos Coca-cola. Antes de reportar esta experiencia, esta empresa ya contaba con algunos modulos SAP implementados (Financieros, FI-CO, Logistica, Recursos Humanos). Evaluacion General. Aunque el trabajo no presenta una estructura cientifica de un articulo, es sumamente interesante (en mi opinion) escuchar en mas detalle de esta experiencia en infonor 2013. Tal vez, recomendaria agregar/presentar un poco mas acerca de las evaluaciones esta implantacion (en su conclusion, mencionan esto como un trabajo futuro). Comentarios menores: - Principalmente cuidar los espaciados entre palabras y puntos. - Figura 1 es muy poco nitida. - Figura 4 dice: "Menus de la tabla xx (estandar en cada pantalla SAP)" xx?

Answer: es

Question: The starting point of this work is the understanding that by having decorrelated neurons (e.g. neurons that only fire on background, or only on foreground regions) one provides independent pieces of information to the subsequent decisions. As such one gives "complementary viewpoints" of the input to the subsequent layers, which can be thought of as performing ensembling/expert combination within the model, rather than using an ensemble of networks. For this, the authors propose a sensible method to decorrelate the activations of intermediate neurons, with the aim of delivering complementary inputs to the final classification layers: they split intermediate neurons to a "foreground" and a "background" subset, and append side-losses that force them to be zero on background and foreground pixels respectively. They demonstrate that this can improve classification on a mid-scale classification example (a fraction of imagenet, and a ResNet with 18, rather than 150 layers), when compared to a "vanilla" baseline that does not use these losses. I enjoyed reading the paper because the idea is simple, smart, and seems to be effective. But there are a few concerns; -firstly, the way of doing this seems very particular to vision. In vision one knows that masking the features (during both training and testing) helps, e.g.

Answer: en

Question: The primary point made by this paper is that given certain architectural characteristics of multi-GPU systems, namely the use of bi-directional PCI-E for communication and the integration of two independent DMA engines on recent GPU devices (providing support for simultaneous independent communications), and given the characteristics of the communications patterns required by synchronous SGD trainers for deep neural networks, namely that the messages are large, dense, and have a fixed length, it makes sense to design communication collectives such as broadcast, reduce, and allreduce specifically for the use case of synchronous SGD training on a multi-GPU system. The paper describes the implementation of these three collectives (broadcast, reduce, and allreduce) using a linear pipelining (LP) scheme on a (logical) ring topology. The paper compares the LP collectives to two alternatives: collectives based on a minimal spanning tree (MST) topology and collectives based on bidirectional exchange (BE). First, a theoretical comparison is made using a standard cost model used in the high performance computing community. When assumptions based on multi-GPU system architecture (very low latency for messages) and on the communication characteristics of synchronous SGD training (very large messages) are integrated into the model, the paper finds that the LP collectives should be less costly than BE collectives by a factor of 2 and less costly than MST collectives by a factor of log(p), where p is the number of GPUs being used. Second, an empirical comparison is performed in which (1) the time required to perform each of the different collectives on a 4-device (k40m) system is measured as a function of message size and (2) the time required to perform each of the different collectives with a 200 MB message length is measured as a function of the number of devices in the system. These measurements show that the LP-based collectives are consistently the fastest. Third, DNN training experiments with AlexNet and GoogLeNet are performed on a 4-device system using three different synchronous SGD algorithms with the different implementations of the collectives (a total of 6 different algorithms in all). Measurements of the communication and computation costs show that the LP collectives reduce communication costs without affecting computation costs (as expected). Measurements of the convergence of the training loss as a function of time for the two DNN architectures show that use of the LP collectives leads to faster training. While the theory says that the costs of LP collectives should be invariant to the number of devices in a multi-GPU system, the empirical work shows that in practice this does not hold going from 4 to 5 devices (in the tested configuration) because in a 5-device system messages must traverse the QPI. Are there other practical considerations that the authors are aware of that affect the scaling of the LP collectives? If so, these should be mentioned in the paper. In the sentence "Worringen (2003) proposed a pipeline collective model in shared memory environment for CPU data, but communications of different MPI processes sharing the same CPU memory bus within the same CPU socket." I really can't figure out what the words after "but communications of different MPI processes" are trying to convey. This sentence is not comprehensible. "Please note the latency term is log p, which is the smallest among algorithms in Table.1. Therefore, MST only suits for high frequent short messages." The claim that MST collectives are only suitable for high-frequency, short messages does not follow from the statement that MST collectives have the smallest latency term. You also need to consider the way the cost scales with message size (the bandwidth term). If the MST collectives had a better bandwidth term than the other collectives, then they would also be superior for large messages. "Let's take an appropriate block size b to ensure n/b ." This looks wrong, since n > b. Should it be b/n ? "However, the parameters are not consistent after several iterations due to the precision issues of float multiplications in Gradient Update." Are you sure the inconsistency in weight estimates across devices is due to multiplication? I would expect that it would be due to gradients being accumulated in different orders; that is, because floating point addition is not commutative. I recommend replacing the term "sub-gradients" in this paper with "partial gradients." In the optimization literature, the term "sub-gradient" has a very specific meaning that differs from this paper's use of the term (see

Answer:
en