R - For Loop API upload - Key

 # Load the necessary packages: httr and jsonlite

install.packages("httr") install.packages("jsonlite") library(httr) library(jsonlite) library(dplyr) # Set up the API endpoint URL and the API key as variables. url <- "https://www.reed.co.uk/api/1.0/search?keywords=analyst&locationName=London&distancefromlocation=55&employerId=575264&resultsToTake=100" api_key <- authenticate( user = "ADD API KEY HERE", password = "", type = "basic") # Create an empty list to store the API responses. responses <- list() # Set up a for loop that iterates over a sequence of values that you want to query the API for. seq(from = 1, to = 1001, by = 100) # Create a sequence going up by 100 for (i in seq(from = 1, to = 1001, by = 100)) { # Construct the API request URL with the i value and the API key req_url <- paste0(url, "&resultsToSkip=", i) # Send the API request using the GET() function from the httr package response <- GET(req_url, api_key) # Parse the JSON response using the fromJSON() function from the jsonlite package response_json <- fromJSON(content(response, "text")) # Store the response in the list responses[[i]] <- response_json$results } # View first table in the list View(responses[[1]]) # View second table in the list - no data as we skipped to 101 View(responses[[2]]) # View table 101 in the list - second table with data View(responses[[101]]) # Combine all tables in the list that have data using bind_rows in dplyr jobs <- bind_rows(responses)

Comments

Post a Comment

Popular posts from this blog

host

import pandas as pd from datetime import datetime import os # Example DataFrame df_final = pd.DataFrame({     'Name': ['Alice', 'Bob', 'Charlie'],     'Age': [25, 30, 35],     'City': ['New York', 'Los Angeles', 'Chicago'] }) # Generate today's date in 'YYYY-MM-DD' format today = datetime.now().strftime("%Y-%m-%d") # Create a dynamic filename filename = f"{today}_data.csv" # Network drive path (Windows) network_folder = r"\\network_drive\shared_folder" # Full path to save the file full_path = os.path.join(network_folder, filename) # Save DataFrame to CSV try:     df_final.to_csv(full_path, index=False)     print(f"File saved successfully to {full_path}") except Exception as e:     print(f"Error saving file: {e}")
Read more

Steps to create SSH key from git bash

Generating an SSH key in OpenSSH involves a few simple steps. Here’s how you can do it: 1. Open a Terminal If you're on Linux or macOS, you can use the built-in terminal. On Windows, you can use the Command Prompt, PowerShell, or Git Bash if you have Git installed. 2. Generate the SSH Key Pair Run the following command: bash Copy code ssh-keygen -t rsa -b 4096 -C "your_email@example.com" Here’s what each option means: -t rsa : Specifies the type of key to create, in this case, RSA. -b 4096 : Specifies the number of bits in the key, 4096 bits is a good choice for strong encryption. -C "your_email@example.com" : Adds a label to the key, usually your email address. 3. Choose a File Location After running the above command, you'll be prompted to choose a location to save the key. By default, it will be saved in ~/.ssh/id_rsa (on Linux or macOS) or in C:\Users\YourUserName\.ssh\id_rsa (on Windows). Press Enter to accept the default location, or specify a diff...
Read more

test

.. https://ubiquis.co.uk/loading-csv-files-with-pdi-metadata-injection-2/ -- Create a temporary table to demonstrate the solution CREATE TABLE YourTable ( ID INT, YourColumn VARCHAR(100) ); -- Insert sample data INSERT INTO YourTable (ID, YourColumn) VALUES (1, '1234_4567_abc'), (2, '789_012_def'), (3, 'xyz'); -- Declare variables for storing results DECLARE @firstPart VARCHAR(100), @secondPart VARCHAR(100); -- Iterate over rows in the table DECLARE @currentID INT = 1; DECLARE @rowCount INT = (SELECT COUNT(*) FROM YourTable); WHILE @currentID <= @rowCount BEGIN -- Retrieve input string from the table DECLARE @inputString VARCHAR(100); SELECT @inputString = YourColumn FROM YourTable WHERE ID = @currentID; -- Check if the delimiter exists in the input string IF CHARINDEX('_', @inputString) > 0 BEGIN -- Find the position of the first occurrence of the delimiter in the input string DECLARE @delimiter...
Read more