Patent application EP16194936A (EP), filed 2016-10-20
Publication number: EP3258393A1
Title: DATA REVISION CONTROL IN LARGE-SCALE DATA ANALYTIC SYSTEMS
Abstract: [0001]    Computer-implemented techniques for data revision control in large-scale data analytic systems. In one embodiment, for example, the techniques encompass a method for data revision control in a large-scale data analytic system that comprises the steps of storing a first version of a dataset that is derived by executing a first version of driver program associated with the dataset; and storing a first build catalog entry comprising an identifier of the first version of the dataset and comprising an identifier of the first version of the driver program.
IPC codes: G06F  17/    30            A I
Claims: number: 1
text: A method for data revision control in a large-scale data analytic system:
number: 2
text: The method of Claim 1, further comprising:
number: 3
text: The method of Claim 2, further comprising:
number: 4
text: The method of Claim 3, wherein first build catalog entry comprises a first branch name; wherein the second build catalog entry comprises a second branch name; and wherein the second branch name is different from the first branch name.
number: 5
text: The method of any of Claims 1-4, further comprising storing the first version of the dataset in a distributed file system.
number: 6
text: The method of any of Claims 1-5, wherein the identifier of the first version of the dataset is an identifier assigned to a commit of a transaction in the context of which the first version of the dataset is stored
number: 7
text: The method of any of Claims 1-6, wherein the first version of the driver program, when executed to produce the first version of the dataset, transforms data of a version of another dataset to produce data of the first version of the dataset.
number: 8
text: The method of any of Claims 1-7, further comprising:
number: 9
text: The method of any of Claims 1-7, further comprising:
number: 10
text: The method of any of Claims 1-7, further comprising:
number: 11
text: The method of any of Claims 1-10, further comprising generating and displaying a dataset provenance graph based, at least in part, on the build catalog entry.
number: 12
text: The method of Claim 11, wherein the dataset provenance graph comprises nodes and directed edges there between, each node representing a dataset and each directed edge between two nodes representing a derivation dependency between the two corresponding datasets.
number: 13
text: The method of Claim 12, wherein a node is color-coded to indicate that the corresponding dataset is out-of-date with respect to another dataset.
number: 14
text: One or more transitory or non-transitory computer-readable media storing one or more programs which, when executed by one or more processors, cause performance of a method as recited in any one of Claims 1-13.
number: 15
text: A system, comprising:
Office action: search_report, dated 2017-12-20
Rejection reasons: novelty_epc_54
Prior art cited: ref_id: US201113224550A
ref_type: patent
severity: background
ref_id: US2016125000A1
ref_type: patent
severity: background
ref_id: US2013246560A1
ref_type: patent
severity: background
ref_id: - WALTER F TICHY ED  - ANONYMOUS: "Design, implementation, and evaluation of a Revision Control System", SOFTWARE ENGINEERING, 2008. ICSE '08. ACM/IEEE 30TH INTERNATIONAL CONFERENCE ON; [INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING], IEEE, PISCATAWAY, NJ, USA, 13 September 1982 (1982-09-13), pages 58 - 67, XP058356406, ISSN: 0270-5257
ref_type: npl
severity: background
ref_id: - "Image Analysis and Recognition : 11th International Conference, ICIAR 2014, Vilamoura, Portugal, October 22-24, 2014, Proceedings, Part I; IN: Lecture notes in computer science , ISSN 1611-3349 ; Vol. 8814", vol. 1439, 1 January 1998, SPRINGER, Berlin, Heidelberg, ISBN: 978-3-642-17318-9, article JOSH MACDONALD ET AL: "PRCS: The project revision control system", pages: 33 - 45, XP055342647, 032548, DOI: 10.1007/BFb0053876
ref_type: npl
severity: background
ref_id: US2013246560
ref_type: patent
severity: background
ref_id: US2016125000
ref_type: patent
severity: novelty_destroying
Final disposition: pending (2017-12-20)