BEU-Result-Fetcher

Web Data Extraction Project

This project focuses on automating data extraction from a specific web page using DOM manipulation techniques. The project has achieved the following milestones till date:

Project Overview

The primary goal of this project is to extract specific information from a web page, specifically targeting student details from an educational institution’s website. The extracted data includes student information, examination details, college information, and subject-wise marks.

Project Components

  1. Web Page: The project interacts with a particular web page, which is the response of a GET request made to the same webpage. This page contains valuable student-related data.

  2. Fetcher.js: The Fetcher.js script is responsible for DOM manipulation. It uses JavaScript to extract the desired data from the web page. It’s structured as follows:

    • It extracts examination semester and month/year.
    • It retrieves student details, including registration number, name, father’s name, and mother’s name.
    • It captures college information, including college code, college name, branch code, and branch name.
    • It extracts subject-wise marks and organizes them in JSON format.
    • The script combines all the extracted data into a single JSON object.

Current Progress

The project has successfully extracted the following information from the web page:

Next Steps

The next phase of the project will involve implementing the data extraction process using Node.js, Cheerio, and the Request module. This transition to Node.js will enable more automated and dynamic data extraction and further data processing.

License

Personal Use License

This project and its associated code, documentation, and any related materials (the “Software”) are provided solely for personal use, non-commercial purposes, and educational purposes. By using this Software, you agree to the following terms:

  1. Personal Use Only: You may use, modify, and run the Software for your personal, non-commercial, and educational purposes only. Personal use includes individual learning, experimentation, and private projects.

  2. No Sharing: You may not share, distribute, or provide access to the Software to others for any purpose, including personal or professional use. It is for your personal use only.

  3. No Professional Use: You may not use the Software in any professional, commercial, or for-profit activities, including but not limited to consulting, services, products, or any work for which you receive compensation.

  4. No Redistribution: You may not redistribute or sublicense the Software in any form, including the original or modified versions.

  5. No Warranty: The Software is provided “as is” without any warranty or support. The author and contributors shall not be held liable for any issues, damages, or consequences resulting from the use of this Software.

  6. No Reverse Engineering: You may not reverse engineer, decompile, or attempt to derive the source code of the Software.

  7. Modification: You may modify the Software for personal use only. Any modifications or derivations must also comply with the terms of this license.

By using this Software, you agree to these terms. If you do not agree with these terms, you are not allowed to use or download the Software. The author of this Software reserves the right to change these terms without notice.

This license is a legal agreement between you and the author of the Software. If you violate these terms, your right to use the Software is terminated. For any questions or permissions beyond the scope of this license, contact the author.

© [BEU-REsult-Fetcher] (2023)

Please note that this project is for educational and learning purposes. Always ensure that you use it responsibly and adhere to legal and ethical standards when interacting with web content.