OpenRaiser/Intern-Atlas huggingface dataset:
MiSpider: a continuous agent on web pages
Authors: Yujiro Fukagaya, Tadachika Ozono, Takayuki Ito, Toramatsu Shintani
Venue: WWW
Year: 2005

In this paper, we propose a Web based agent system called MiSpider, which provides intelligent web services on web browsers. MiSpider enables users to use agents on existing browsers. Users can use MiSpider all over the world only to access the Internet. MiSpider Agent has persistency, and agents condition doesn't change if users change a browsing page. Moreover, agents have a message passing skill to communicate among the agents.
A modeling approach to federated identity and access management
Authors: Martin Gaedke, Johannes Meinecke, Martin Nussbaumer
Venue: WWW
Year: 2005

As the Web is increasingly used as a platform for heterogeneous applications, we are faced with new requirements to authentication, authorization and identity management. Modern architectures have to control access not only to single, isolated systems, but to whole business-spanning federations of applications and services. This task is complicated by the diversity of today's specifications concerning e.g. privacy, system integrity and distribution in the web. As an approach to such problems, in this paper, we introduce a solution catalogue of reusable building blocks for Identity and Access Management (IAM). The concepts of these blocks have been realized in a configurable system that supports IAM solutions for Web-based applications.
The volume and evolution of web page templates
Authors: David Gibson, Kunal Punera, Andrew Tomkins
Venue: WWW
Year: 2005

Web pages contain a combination of unique content and template material, which is present across multiple pages and used primarily for formatting, navigation, and branding. We study the nature, evolution, and prevalence of these templates on the web. As part of this work, we develop new randomized algorithms for template extraction that perform approximately twenty times faster than existing approaches with similar quality. Our results show that 40--50% of the content on the web is template content. Over the last eight years, the fraction of template content has doubled, and the growth shows no sign of abating. Text, links, and total HTML bytes within templates are all growing as a fraction of total content at a rate of between 6 and 8% per year. We discuss the deleterious implications of this growth for information retrieval and ranking, classification, and link analysis.
Analyzing online discussion for marketing intelligence
Authors: Natalie S. Glance, Matthew Hurst, Kamal Nigam, Matthew Siegler, Robert Stockton, Takashi Tomokiyo
Venue: WWW
Year: 2005

We present a system that gathers and analyzes online discussion as it relates to consumer products. Weblogs and online message boards provide forums that record the voice of the public. Woven into this discussion is a wide range of opinion and commentary about consumer products. Given its volume, format and content, the appropriate approach to understanding this data is large-scale web and text data mining. By using a wide variety of state-of-the-art techniques including crawling, wrapping, text classification and computational linguistics, online discussion is gathered and annotated within a framework that provides for interactive analysis that yields marketing intelligence for our customers.
The indexable web is more than 11.5 billion pages
Authors: Antonio Gulli, Alessio Signorini
Venue: WWW
Year: 2005

In this short paper we estimate the size of the public indexable web at 11.5 billion pages. We also estimate the overlap and the index size of Google, MSN, Ask/Teoma and Yahoo!
Building an open source meta-search engine
Authors: Antonio Gulli, Alessio Signorini
Venue: WWW
Year: 2005

In this short paper we introduce Helios, a flexible and efficient open source meta-search engine. Helios currently runs on the top of 18 search engines (in Web, Books, News, and Academic publication domains), but additional search engines can be easily plugged in. We also report some performance mesured during its development.
Extracting context to improve accuracy for HTML content extraction
Authors: Suhit Gupta, Gail E. Kaiser, Salvatore J. Stolfo
Venue: WWW
Year: 2005

Previous work on content extraction utilized various heuristics such as link to text ratio, prominence of tables, and identification of advertising. Many of these heuristics were associated with "settings", whereby some heuristics could be turned on or off and others parameterized by minimum or maximum threshold values. A given collection of settings - such as removing table cells with high linked to non-linked text ratios and removing all apparent advertising -- might work very well for a news website, but leave little or no content left for the reader of a shopping site or a web portal We present a new technique, based on incrementally clustering websites using search engine snippets, to associate a newly requested website with a particular "genre", and then employ settings previously determined to be appropriate for that genre, with dramatically improved content extraction results overall.
Executing incoherency bounded continuous queries at web data aggregators
Authors: Rajeev Gupta, Ashish Puri, Krithi Ramamritham
Venue: WWW
Year: 2005

Continuous queries are used to monitor changes to time varying data and to provide results useful for online decision making. Typically a user desires to obtain the value of some function over distributed data items, for example, to determine when and whether (a) the traffic entering a highway from multiple feed roads will result in congestion in a thoroughfare or (b) the value of a stock portfolio exceeds a threshold. Using the standard Web infrastructure for these applications will increase the reach of the underlying information. But, since these queries involve data from multiple sources, with sources supporting standard HTTP (pull-based) interfaces, special query processing techniques are needed. Also, these applications often have the flexibility to tolerate some incoherency, i.e., some differences between the results reported to the user and that produced from the virtual database made up of the distributed data sources.In this paper, we develop and evaluate client-pull-based techniques for refreshing data so that the results of the queries over distributed data can be correctly reported, conforming to the limited incoherency acceptable to the users.We model as well as estimate the dynamics of the data items using a probabilistic approach based on Markov Chains. Depending on the dynamics of data we adapt the data refresh times to deliver query results with the desired coherency. The commonality of data needs of multiple queries is exploited to further reduce refresh overheads. Effectiveness of our approach is demonstrated using live sources of dynamic data: the number of refreshes it requires is (a) an order of magnitude less than what we would need if every potential update is pulled from the sources, and (b) comparable to the number of messages needed by an ideal algorithm, one that knows how to optimally refresh the data from distributed data sources. Our evaluations also bring out a very practical and attractive tradeoff property of pull based approaches, e.g., a small increase in tolerable incoherency leads to a large decrease in message overheads.
Predicting outcomes of web navigation
Authors: Jacek Gwizdka, Ian Spence
Venue: WWW
Year: 2005

Two exploratory studies examined the relationships among web navigation metrics, measures of lostness, and success on web navigation tasks. The web metrics were based on counts of visits to web pages, properties of the web usage graph, and similarity to an optimal path. Metrics based on similarity to an optimal path were good predictors of lostness and task success.
WEBCAP: a capacity planning tool for web resource management
Authors: Sami Habib, Maytham Safar
Venue: WWW
Year: 2005

A staggering number of multimedia applications are being introduced every day. Yet, the inordinate delays encountered in retrieving multimedia documents make it difficult to use the Web for real-time applications such as educational broadcasting, video conferencing, and multimedia streaming. The problem of delivering multimedia documents in time while placing the least demands on the client, network and server resources is a challenging optimization problem. The WEBCAP is ongoing project that explores applying capacity planning techniques to manage or tune the Web resources (client, network, server) for optimal or near optimal performance, subject to minimizing the retrieval cost while satisfying the real-time constraints and available resources. The WEBCAP project consists of four software modules: object extractor, object representer, object scheduler, and system tuner. The four modules are connected serially with 3 feedback-loops. In this paper, we focus on how to extract objects from multimedia document and how to represent them as object and operation flow graphs while maintaining precedence relations among the objects.
Predicting navigation patterns on the mobile-internet using time of the week
Authors: Martin Halvey, Mark T. Keane, Barry Smyth
Venue: WWW
Year: 2005

A predictive analysis of user navigation in the Internet is presented that exploits time-of-the-week data. Specifically, we investigate time as an environmental factor in making predictions about user navigation. An analysis is carried out of a large sample of user, navigation data (over 3.7 million sessions from 0.5 million users) in a mobile-Internet context to determine whether user surfing patterns vary depending on the time of the week on which they occur. We find that the use of time improves the predictive accuracy of navigation models.
XJ: facilitating XML processing in Java
Authors: Matthew Harren, Mukund Raghavachari, Oded Shmueli, Michael G. Burke, Rajesh Bordawekar, Igor Pechtchanski, Vivek Sarkar
Venue: WWW
Year: 2005

The increased importance of XML as a data representation format has led to several proposals for facilitating the development of applications that operate on XML data. These proposals range from runtime API-based interfaces to XML-based programming languages. The subject of this paper is XJ, a research language that proposes novel mechanisms for the integration of XML as a first-class construct into Java™. The design goals of XJ distinguish it from past work on integrating XML support into programming languages --- specifically, the XJ design adheres to the XML Schema and XPath standards. Moreover, it supports in-place updates of XML data thereby keeping with the imperative nature of Java. We have built a prototype compiler for XJ, and our preliminary experiments demonstrate that the performance of XJ programs can approach that of traditional low-level API-based interfaces, while providing a higher level of abstraction.
Diversified SCM standard for the Japanese retail industry
Authors: Koichi Hayashi, Naoki Koguro, Reki Murakami
Venue: WWW
Year: 2005

In this paper, we present the concept of a diversified SCM (supply chain management) standard and distributed hub architecture which were used in B2B experiments for the Japanese retail industry. The conventional concept of B2B standards develops a single ideal set of business transactions to be supported. In contrast, our concept allows a wide range of diverse business transaction patterns necessary for industry supply chains. An industry develops a standard SCM model that partitions the whole supply chain into several transaction segments, each of which provides alternative business transaction patterns. For B2B collaboration, companies must agree on a collaboration configuration, which chooses the transaction alternatives from each segment. To support the development of a B2B system that executes an agreed collaboration, we introduce an SOA (service oriented architecture) based pattern called a distributed hub architecture. As a hub of B2B collaboration, it includes a complete set of services that can process every possible business transaction included in a standard SCM model. However, it does not function as a centralized service that coordinates participants. Instead, it is deployed on every participant and executes the assigned part of the supply chain collaboratively with other distributed hubs. Based on this concept, we analyzed actual business transactions in the Japanese retail industry and developed a standard SCM model, which represents more than a thousand possible transaction patterns. Based on the model, we developed an experimental system for the Japanese retail industry. The demonstration experiment involved major players in the industry including one of the largest general merchandise stores, one of the largest wholesalers, and major manufacturers in Japan.
Improving text collection selection with coverage and overlap statistics
Authors: Thomas Hernandez, Subbarao Kambhampati
Venue: WWW
Year: 2005

In an environment of distributed text collections, the first step in the information retrieval process is to identify which of all available collections are more relevant to a given query and which should thus be accessed to answer the query. We address the challenge of collection selection when there is full or partial overlap between the available text collections, a scenario which has not been examined previously despite its real-world applications. To that end, we present COSCO, a collection selection approach which uses collection-specific coverage and overlap statistics. We describe our experimental results which show that the presented approach displays the desired behavior of retrieving more new results early on in the collection order, and performs consistently and significantly better than CORI, previously considered to be one of the best collection selection systems.
Representing personal web information using a topic-oriented interface
Authors: Zhigang Hua, Hao Liu, Xing Xie, Hanqing Lu, Wei-Ying Ma
Venue: WWW
Year: 2005

Nowadays, Web activities have become daily practice for people. It is therefore essential to organize and present this continuously increasing Web information in a more usable manner. In this paper, we developed a novel approach to reorganize personal Web information as a topic-oriented interface. In our approach, we proposed to utilize anchor, title and URL information to represent content information for the browsed Web pages rather than the content body. Furthermore, we explored three methods to organize personal Web information: 1) top-down statistical clustering; 2) salience phrase based clustering; and 3) support vector machine (SVM) based classification. Finally, we conducted a usability study to verify the effectiveness of our proposed solution. The experimental results demonstrated that users could visit the pages that have been browsed previously more easily with our approach than existing solutions.
A study on combination of block importance and relevance to estimate page relevance
Authors: Shen Huang, Yong Yu, Shengping Li, Gui-Rong Xue, Lei Zhang
Venue: WWW
Year: 2005

Some work showed that segmenting web pages into "semantic independent" blocks could help to improve the whole page retrieval. One key and unexplored issue is how to combine the block importance and relevance to a given query. In this poster, we first propose an automatic way to measure block importance to improve retrieval. After that, user information need is also concerned to refine block importance for different users.
How to make web sites talk together: web service solution
Authors: Hoang Pham Huy, Takahiro Kawamura, Tetsuo Hasegawa
Venue: WWW
Year: 2005

Integrating web sites to provide more efficient services is a very promising way in the Internet. For example searching house for rent based on train system or preparing a holiday with several constrains such as hotel, air ticket, etc... From resource view point, current web sites in the Internet already provide quite enough information. However, the challenge is these web sites just provide information but do not support any mechanism to exchange them. As a consequence, it is very often that a human user has to take the role to "link" several web sites by browsing each one and get the concrete information. The reason comes from a historical objective. Web sites were developed for human users browsing and so, they do not support any machine-understandable mechanism.Current researches in WWW environment already propose several solutions to make newly web sites become understandable to other web sites so that they can be integrated. However, the question is how to integrate existing web sites to these new one. Evidently, redeveloping all of them is an unacceptable solution. In this paper, we propose a solution of Web Service Gateway to "wrap" existing web sites in Web services. Thus, without any efforts to duplicate the Web sites code, these services inherit all features from the sites while can be enriched with other Web service features like UDDI publishing, semantic describing, etc. This proposal was developed in Toshiba with Web Service Gateway and Wrapper Generator System. By using these systems, several integrated-applications were built and they are also presented and evaluated in this paper.
Web services security configuration in a service-oriented architecture
Authors: Takeshi Imamura, Michiaki Tatsubori, Yuichi Nakamura, Christopher Giblin
Venue: WWW
Year: 2005

Security is one of the major concerns when developing mission-critical business applications, and this concern motivated the Web Services Security specifications. However, the existing tools to configure the security properties of Web Services give a technology-oriented view; only assisting in choosing data to encrypt and the encryption algorithms to use. A user must manually bridge the gap between the security requirements and the configuration, which could cause extra configuration costs and lead to potential misconfiguration hazards. To ease this situation, we came up with refining security requirements from business to technology, leveraging the concepts of Service-Oriented Architecture (SOA) and Model-Driven Architecture (MDA). Security requirements are gradually transformed to more detailed ones or countermeasures by bridging the gap between them by using best practice patterns.
Partitioning of Web graphs by community topology
Authors: Hidehiko Ino, Mineichi Kudo, Atsuyoshi Nakamura
Venue: WWW
Year: 2005

We introduce a stricter Web community definition to overcome boundary ambiguity of a Web community defined by Flake, Lawrence and Giles [2], and consider the problem of finding communities that satisfy our definition. We discuss how to find such communities and hardness of this problem.We also propose Web page partitioning by equivalence relation defined using the class of communities of our definition. Though the problem of efficiently finding all communities of our definition is NP-complete, we propose an efficient method of finding a subclass of communities among the sets partitioned by each of n-1 cuts represented by a Gomory-Hu tree [10], and partitioning a Web graph by equivalence relation defined using the subclass.According to our preliminary experiments, partitioning by our method divided the pages retrieved by keyword search into several different categories to some extent.
Innovation for a human-centered network: NTT's R&D activities for achieving the NTT group's medium-term management strategy
Authors: Yuji Inoue
Venue: WWW
Year: 2005

This talk presents NTT's approach for realizing a Human-Centered Network. Last November, we announced the NTT Group's Medium-Term Management Strategy, which consists of three management objectives: (1) building the ubiquitous broadband market and helping achieve the e-Japan Strategy and the u-Japan Initiative; (2) building a safe, secure, and convenient communications network environment and broadband access infrastructure, while achieving a seamless migration from the legacy telephone network to the next generation network; and (3) striving to increase corporate value and achieve sustainable growth. Since the management strategy takes account of Japan's future social issues such as declining birthrate and aging population, the need to reduce the environmental load, etc, we believe that the R&D activities directed towards accomplishing these objectives consequently lead to the realization of a Human-Centered Network.
Introducing multimodal character agents into existing web applications
Authors: Kimihito Ito
Venue: WWW
Year: 2005

This paper proposes a framework in which end-users can instantaneously modify existing Web applications by introducing multimodal user-interface. The authors use the IntelligentPad architecture and MPML as the basis of the framework. Example applications include character agents that read the latest news on a news Web site. The framework does not require users to write any program codes or scripts to introduce multimodal user-interface to existing Web applications.
Multispace information visualization framework for the intercomparison of data sets retrieved from web services
Authors: Masahiko Itoh, Yuzuru Tanaka
Venue: WWW
Year: 2005

We introduce a new visualization framework for the intercomparison of more than one data set retrieved from Web services. In our framework, we use more than one visualization space simultaneously, each of which visualizes a single data set retrieved from the Web service. For this purpose, we provide a new 3D component for accessing Web services, and provide a 3D space component, in which data set retrieved from the Web service is visualized. Moreover, our framework provides users with various operations applicable to these space components, i.e., union, intersection, set-difference, cross-product, selection, projection, and joins.
AwareDAV: a generic WebDAV notification framework and implementation
Authors: Henning Qin Jehøj, Niels Olof Bouvin, Kaj Grønbæk
Venue: WWW
Year: 2005

WebDAV needs awareness support in order to be a full-fledged collaboration system, This paper introduces AwareDAV, a new WebDAV extension framework enabling shared awareness through event notification. By extending the WebDAV protocol with seven new request-methods and an extensible XML based event subscription scheme, AwareDAV supports fine grained event subscriptions over a range of transport mechanisms and enables a wide range of collaboration scenarios. This paper describes the design of AwareDAV, its API, experiences with its initial implementation, as well as a comparison with Microsoft Exchange and WebDAV-notify.
A framework for determining necessary query set sizes to evaluate web search effectiveness
Authors: Eric C. Jensen, Steven M. Beitzel, Ophir Frieder, Abdur Chowdhury
Venue: WWW
Year: 2005

We describe a framework of bootstrapped hypothesis testing for estimating the confidence in one web search engine outperforming another over any randomly sampled query set of a given size. To validate this framework, we have constructed and made available a precision-oriented test collection consisting of manual binary relevance judgments for each of the top ten results of ten web search engines across 896 queries and the single best result for each of those queries. Results from this bootstrapping approach over typical query set sizes indicate that examining repeated statistical tests is imperative, as a single test is quite likely to find significant differences that do not necessarily generalize. We also find that the number of queries needed for a repeatable evaluation in a dynamic environment such as the web is much higher than previously studied.