Patent application EP16002727A (EP), filed 2016-12-22
Publication number: EP3220266A1
Title: UNIFIED CLIENT FOR DISTRIBUTED PROCESSING PLATFORM
Abstract: Techniques are described for providing a unified client to interact with a distributed processing platform such as a Hadoop cluster. The unified client may include multiple subclients each of which is configured to interface with a particular subsystem of the distributed processing platform, such as MapReduce, Hive, Spark, and so forth. The unified client may be included in an application to provide, for the application, a single interface for communications between the application and the distributed processing platform during a unified communication session.
IPC codes: G06F   9/    50            A I
G06F   9/    54            A I
Claims: number: 1
text: A computer-implemented method performed by at least one processor, the method comprising:
number: 2
text: The method of claim 1, further comprising:
number: 3
text: The method of claim 1 or 2,
wherein the at least two data processing operations are performed in serial by the at least two sub-systems in response to sequential calls from the at least two sub-clients; or
wherein the at least two data processing operations are performed in parallel by the at least two sub-systems in response to calls from the at least two sub-clients.
number: 4
text: The method of any of the preceding claims,
wherein the at least two sub-clients are different types of sub-clients that interface with different sub-systems of the distributed processing platform; and/or
wherein a reference is provided by a first sub-client to a second sub-client of the at least two sub-clients, the reference indicating results of a first data processing operation performed by the first sub-client.
number: 5
text: The method of any of the preceding claims, wherein the plurality of sub-clients include one or more of:
number: 6
text: The method of any of the preceding claims, wherein the distributed processing platform is a Hadoop platform.
number: 7
text: A system comprising:
number: 8
text: The system of claim 7, the operations further comprising:
number: 9
text: The system of claim 7 or 8,
wherein the at least two data processing operations are performed in serial by the at least two sub-systems in response to sequential calls from the at least two sub-clients; or
wherein the at least two data processing operations are performed in parallel by the at least two sub-systems in response to calls from the at least two sub-clients.
number: 10
text: The system of any of claims 7 to 9,
wherein the at least two sub-clients are different types of sub-clients that interface with different sub-systems of the distributed processing platform; and/or
wherein a reference is provided by a first sub-client to a second sub-client of the at least two sub-clients, the reference indicating results of a first data processing operation performed by the first sub-client.
number: 11
text: The system of any of claims 7 to 10, wherein the plurality of sub-clients include one or more of:
number: 12
text: The system of any of claims 7 to 11, wherein the distributed processing platform is a Hadoop platform.
number: 13
text: One or more computer-readable storage media storing instructions which, when executed by at least one processor, cause the at least one processor to perform operations comprising:
number: 14
text: The one or more computer-readable storage media of claim 13, the operations further comprising:
number: 15
text: The one or more computer-readable storage media of claim 13 or 14,
wherein the plurality of sub-clients include one or more of:
Office action: search_report, dated 2017-09-20
Rejection reasons: novelty_epc_54
Prior art cited: ref_id: WO2015153699A1
ref_type: patent
severity: background
ref_id: - ANONYMOUS: "Adapter pattern - Wikipedia, the free encyclopedia", 4 April 2015 (2015-04-04), XP055275559, Retrieved from the Internet <URL:https://en.wikipedia.org/w/index.php?title=Adapter_pattern&oldid=654971255> [retrieved on 20160526]
ref_type: npl
severity: background
ref_id: US2010153444A1
ref_type: patent
severity: background
ref_id: - "Distributed Systems: Principles and Paradigms (2nd Edition)", 12 October 2006, PRENTICE HALL, ISBN: 978-0-13-239227-3, article ANDREW S. TANENBAUM: "Distributed Systems: Principles and Paradigms (2nd Edition)", pages: 0 - 26, XP055115159
ref_type: npl
severity: background
ref_id: - ZHANG XUEFU: "Apache Hive on Apache Spark: Motivations and Design Principles", CLOUDERA ENGINEERING BLOG, 1 July 2014 (2014-07-01), pages 1 - 12, XP055388071, Retrieved from the Internet <URL:https://blog.cloudera.com/blog/2014/07/apache-hive-on-apache-spark-motivations-and-design-principles/> [retrieved on 20170705]
ref_type: npl
severity: background
ref_id: - MICHAEL WALKER: "Lambda Architecture for Big Data Systems", 4 December 2013 (2013-12-04), Data Science Central, XP055154043, Retrieved from the Internet <URL:http://www.datasciencecentral.com/profiles/blogs/lambda-architecture-for-big-data-systems> [retrieved on 20141119]
ref_type: npl
severity: background
ref_id: US2010153444
ref_type: patent
severity: novelty_destroying
ref_id: - Andrew S. Tanenbaum, "Distributed Systems: Principles and Paradigms (2nd Edition)", Distributed Systems: Principles and Paradigms (2nd Edition), Prentice Hall, (20061012), pages 0 - 26, ISBN 978-0-13-239227-3, XP055115159 [I] 1,2,4,7,10,13,14 * Section 1.3.2 *
ref_type: npl
severity: background
ref_id: - Zhang Xuefu, "Apache Hive on Apache Spark: Motivations and Design Principles", Cloudera Engineering Blog, (20140701), pages 1 - 12, URL: https://blog.cloudera.com/blog/2014/07/apache-hive-on-apache-spark-motivations-and-design-principles/, (20170705), XP055388071 [I] 1,2,4-8,10-15 * pages  2, 6 *
ref_type: npl
severity: background
ref_id: - Michael Walker, "Lambda Architecture for Big Data Systems", Data Science Central, (20131204), URL: http://www.datasciencecentral.com/profiles/blogs/lambda-architecture-for-big-data-systems, (20141119), XP055154043 [A] 1-15 * pages  1-2 *
ref_type: npl
severity: background
Final disposition: pending (2017-09-20)