crawl-sanfoundry-mcqs

CRAWL DATA sanfoundry.com

This is a crawler to crawl data from sanfoundry.com and store it in a json file. This crawler is written in python using Flask to create a REST API to crawl data from sanfoundry.com.

Table of contents

1. Operating system
   • OS - Processes
   • OS - Distributed Communication
   • OS - CPU Scheduling
   • OS - Process Synchronization
   • OS - Deadlocks
   • OS - Memory Management
   • OS - IO Systems
   • OS - Real Time Operating Systems (RTOS)
   • OS - Multimedia Systems
   • OS - Security
   • OS - Linux System
   • OS - Virtual Memory
   • OS - File Systems and their Implementation
   • OS - Mass-Storage Structures
   • OS - Protection
   • OS - Distributed Operating System
   • OS - Distributed File Systems

Installation

1. Clone the repository

   git clone https://github.com/TienNHM/crawl-sanfoundry-mcqs.git
   

2. Install the dependencies

   pip install Flask
   pip install requests
   pip install beautifulsoup4
   pip install jsonify
   

3. Run the server

   python app.py
   

API Endpoints

GET /mcqs/<url>

Example:

GET /mcqs/operating-system-mcqs-memory-management-swapping-1

Note: The url is the last part of the url of the page on sanfoundry.com. For example, the url of the page https://www.sanfoundry.com/operating-system-questions-answers-memory-management-swapping-1/ is operating-system-mcqs-memory-management-swapping-1.