Interface Summary Interface Description HandlerThis interface represents the method call when the response is makeValidResponse the parsing logic will be up to individual implementations. HandlerRouterThis interface allows the user to map request to handleable. Interruptible ProxyProviderThis interface allows the user to define proxies to be used for requests. ValidatorRouterThis interface allows the user to map request to handleable. Worker WorkerManager
Class Summary Class Description CrawlerThis class handles the coordination between classes during the pre and post fetching of a page such as executing threads, calling to fetcher and manipulating the priority of a scheduled request. Crawler.AsyncCrawlerCallbackProcessorThis class methods is executed upon the completion of fetcher. Crawler.BuilderA builder for crawler class. Session Session.BuilderBuilder for Session. Session.Key<T>A class representing the key for a session. SleepScheduler ThreadedWorkerManager ThreadedWorkerManager.AbstractManagedBlockingWorkerThis abstract class exposes the methods to allow submitting tasks for multithreading and implements inline blocking method. UrlRouterThis class provides an implementation to select a handler based on the url from which they were fetched.
Exception Summary Exception Description FatalHandlerExceptionThis class defines fatal runtime exception for