Number of connections Within this feature, you can input the desired number of simultaneous connections. Typically, it is recommended to have between 5 to 10 connections. The optimal number of connections will vary depending on the number of lines you have and the connection speed provided by your internet service provider.
Save results automatically To save your results automatically every N of minutes. This option shows how frequently your interim search results are to be saved.
Time out for one connection This option gives the maximum amount of time in seconds during which each document (one connection) is downloaded.
At the end of this time the program starts downloading the next document.
Number of retries The program allows you to specify the number of attempts made to download each document. This option determines how many times the program will try to download the same file in case the connection with the provider or the website link is interrupted. You can set the desired number of attempts, and the program will make those attempts accordingly.
Copy subdirectory structure from website - to copy the structure of a subdirectory from the website you wish to download. If this option is highlighted your hard drive will be able to create directories like the ones on the website you are downloading.
Apply domainname.com=www.domainname.com In certain websites, the hyperlinks to other sites may not include the "www" prefix, resulting in the possibility of downloading the same documents multiple times in different directories. To address this issue, the program offers an option specifically designed for such anomalies in internet sites. By enabling this option, addresses like INTERNET-SOFT.COM and
WWW.INTERNET-SOFT.COM will be treated as synonymous. The program automatically adds the "www" prefix during this type of search to ensure consistency.
Expand the nodes parents to make the node visible This convenience option is intended to graphically represent the tree of websites scanned. In this way the option shows the current branches of the site being downloaded and enables the program to graphically depict the locations where sites are downloaded.
Identify browser as This option determines how the program will be identified when downloading a website from a remote server. For instance, when using Internet Explorer 8.0 to download a webpage, the remote server carries out this task and records the server's contents as a protocol. Similarly, the Extractor program replicates this behavior when visiting a website.
Proxy Server Please input the properties of the proxy server if you are utilizing one. Additionally, you can select any other desired options for downloading and searching for hyperlinks.
We would like to highlight the following: Considering the vast number of pages present on the worldwide web, significant data processing capability and ample disk space on your computer may be required to download links and websites. A few hours of program operation can occupy several gigabytes of storage on your hard disk.
File Type Filter: Limiting the types and sizes of filesYou have the option to define the specific file types you wish to download and set size limitations for them. This feature is particularly useful when you only want to download text documents without banners, images, or archive files.
To accomplish this, you can select the checkboxes next to file extensions such as html, htm, txt, shtml, etc. This will ensure that only files with these extensions are downloaded. Additionally, you can use the menu options to restrict the size of the files to be downloaded. If you choose the "Load all file sizes" option, files of all sizes will be downloaded. Alternatively, by selecting specific file size limits (specified in bytes), you will only obtain files within those size ranges.
URL / Domain Filter: You can apply limitations based on directory names, domain names, and file names. By entering specific words, you can set filters to control the download process.
For example, let's say you only want to download files from the website
https://www.internet-soft.com. In this case, you would simply enter "internet-soft" as the filter word.
The filter can be used in different ways:
- Adjusting the word content in a domain name: You can modify the filter to include or exclude certain words within the domain name.
- Expanding the domain: The filter allows you to include or exclude specific domain names based on their properties.
- Adjusting the contents of a word in a directory name: You can specify the filter to modify the presence or absence of certain words within directory names.
- Modifying any given word in the file name: The filter enables you to include or exclude files based on specific words within their names.
The filter can be used for both inclusion and exclusion. If you add words to the exclude filter, any URLs containing those words will not result in the corresponding files being downloaded. On the other hand, if you utilize the include filter, only names containing the properties specified in the filter will be downloaded.
Domains: Limitations by domain type. This option allows you to impose limitations based on the type and country of the domain. Simply click on the desired domain type to apply the restriction. These settings encompass the primary configurations of the program.
Upon closing the menu window, the entered data is automatically saved as default, enabling you to initiate website downloads. At this point, you can commence a project. The default properties you previously specified will be automatically retrieved when starting a new project. However, these properties can be modified and saved separately for each individual project, allowing for customization.
In essence, the term "project" encompasses the complete set of options that define the target site and its associated properties to be downloaded.
Downloading a website To initiate the download of a website onto your hard drive, follow these steps to create a downloading project:
- Click on "Project" in the main menu, then select "New." This will open a window where you can view websites and enter download properties.
- Enter the address of the website you wish to download into the designated field.
- Click on "Download/Extract" to begin the downloading process.
- The lower panel will display the pages of the website that are currently being downloaded.
Once the download is complete, the websites will be saved on your computer. Now, let's delve into a more detailed exploration of the primary control panels utilized in a downloading project.