Instagram Grabber PHP

temtem · Đăng lúc 13-9-2017 14:37:17

1. List top images by hashtag

<?php
function scrape_insta_hash($tag) {
$insta_source = file_get_contents('https://www.instagram.com/explore/tags/'.$tag.'/'); // instagrame tag url
$shards = explode('window._sharedData = ', $insta_source);
$insta_json = explode(';</script>', $shards[1]);
$insta_array = json_decode($insta_json[0], TRUE);
return $insta_array; // this return a lot things print it and see what else you need
}
$tag = 'visitvietnam'; // tag for which ou want images
$results_array = scrape_insta_hash($tag);
$limit = 10; // provide the limit thats important because one page only give some images then load more have to be clicked
$image_array= array(); // array to store images.
for ($i=0; $i < $limit; $i++) {
$latest_array = $results_array['entry_data']['TagPage'][0]['tag']['media']['nodes'][$i];
$image_data = '<img src="'.$latest_array['thumbnail_src'].'">'; // thumbnail and same sizes
//$image_data = '<img src="'.$latest_array['display_src'].'">'; actual image and different sizes
array_push($image_array, $image_data);
}
foreach ($image_array as $image) {
echo $image;// this will echo the images wrap it in div or ul li what ever html structure
}
// for getting all images have to loop function for more pages
// for confirmation you are getting correct images view
//https://www.instagram.com/explore/tags/your-tag-name/
?>

Sao chép mã

temtem · Đăng lúc 13-9-2017 16:15:30

Bulk Downloader from any public instagram users.
1.Login the instagram, export the cookies for your login session.
2. Create a script called: instagram_dl.php

<?php
include("includes/rollingcurlx.class.php");
/**
* Crawls through user's page and downloads all avaliable images/videos
*/
function download($RCX, $username, $max_id = 0) {
$id = '';
$lastId = '';
if ($max_id > 0) {
$id = $max_id;
}
$userURL = "https://www.instagram.com/" . $username . "/media/?&max_id=" . $id;
$ch = curl_init();
$curl_options = array(
CURLOPT_URL => $userURL,
CURLOPT_REFERER => "https://www.instagram.com",
CURLOPT_USERAGENT => "User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.6) Gecko/20091201 Firefox/3.5.6 (.NET CLR 3.5.30729)",
CURLOPT_HEADER => 0,
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 10,
CURLOPT_HTTPHEADER => array('Content-type: application/json'),
CURLOPT_COOKIEFILE => __DIR__ . "/cookies.txt",
CURLOPT_SSL_VERIFYPEER => false
);
curl_setopt_array($ch, $curl_options);
$response = curl_exec($ch);
if(empty($response)){
die("API returned nothing\r\n");
}
curl_close($ch);
$json = json_decode($response, true);
if($json['status'] == "ok" && !empty($json['items'])) {
// Loop over json, get the filename, URL and timestamp
foreach ($json['items'] as $data) {
if($data['type'] == "video") {
$imageURL = $data['videos']['standard_resolution']['url'];
$name = explode("/", $imageURL);
$name = $name[count($name) - 1];
} else {
$urlSplit = explode("/",
$data['images']['standard_resolution']['url']);
$name = $urlSplit[count($urlSplit) - 1];
// Some images have URLs of different lengths
// "/s1080x1080/" ensures the image is the largest possible
if(count($urlSplit) == 6) {
$imageURL = $urlSplit[0] . "//" . $urlSplit[2]
. "/" . $urlSplit[3] . "/" . $urlSplit[4] . "/"
. $urlSplit[5];
} elseif(count($urlSplit) == 7) {
$imageURL = $urlSplit[0] . "//" . $urlSplit[2]
. "/" . $urlSplit[3] . "/s1080x1080/" . $urlSplit[5]
. "/" . $urlSplit[6];
} elseif(count($urlSplit) == 8) {
$imageURL = $urlSplit[0] . "//" . $urlSplit[2]
. "/" . $urlSplit[3] . "/" . $urlSplit[4]
. "/s1080x1080/" . $urlSplit[6] . "/" . $urlSplit[7];
} elseif(count($urlSplit) == 9) {
$imageURL = $urlSplit[0] . "//" . $urlSplit[2]
. "/" . $urlSplit[3] . "/" . $urlSplit[4]
. "/s1080x1080/" . $urlSplit[6] . "/" . $urlSplit[7]
. "/" . $urlSplit[8];
} else {
$imageURL = $data['images']['standard_resolution']['url'];
}
}
// Add image to download queue
$RCX->addRequest($imageURL, null, 'save', ['fileName' => $name, 'created_time' => $data['created_time'], 'username' => $username]);
// Instagram only shows one page of images at a given time, saves the id of the last image
$lastId = $data['id'];
}
} else {
die("Invalid username or private account.\r\n");
}
// Recurse if more images are avaliable
if($json['more_available'] == true){
return download($RCX, $username, $lastId);
} else {
$RCX->setOptions([array(
CURLOPT_REFERER => "http://instagram.com",
CURLOPT_USERAGENT => "User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.6) Gecko/20091201 Firefox/3.5.6 (.NET CLR 3.5.30729)",
CURLOPT_HEADER => 0,
CURLOPT_RETURNTRANSFER => true,
CURLOPT_TIMEOUT => 10,
)]);
$RCX->execute();
}
}
function save($response, $url, $request_info, $user_data, $time) {
$saveto = "./" . $user_data['username'] . "/";
// Create user's folder
if(!file_exists($saveto)) {
if (!mkdir($saveto, 0744, true)) {
die(date("Y-m-d H:i:s") . " - Failed to create folder.\r\n");
}
}
$fileName = $user_data['fileName'];
$timestamp = $user_data['created_time'];
// Instagram API sometimes gives weird file names
if(strpos($fileName, "ig_cache_key")) {
$fileName = explode("?", $fileName)[0];
}
$fileLocation = $saveto . $timestamp . "_" . $fileName;
if(!file_exists($fileLocation)) {
// Check error code
if($request_info['http_code'] == "200") {
echo("[" . $request_info['http_code'] . "] " .date("Y-m-d H:i:s") . " - saved " . $fileName . "\r\n");
} else {
echo("[" . $request_info['http_code'] . "] " .date("Y-m-d H:i:s") . " - Error downloading " . $fileName . " @ " . $url . "\r\n");
return;
}
$fp = fopen($fileLocation, 'w');
fwrite($fp, $response);
fclose($fp);
}
}
if(!isset($argv[1]) || empty($argv[1])) {
die("Usage: php " . $_SERVER["SCRIPT_FILENAME"] . " <username>\r\n");
}
if (!function_exists('curl_init')) {
die(date("Y-m-d H:i:s") . " - cURL is not installed.\r\n");
}
download(new RollingCurlX(10), $argv[1], 0);
?>

Sao chép mã

3. Create a scripted called:rollingcurlx.class.php put into the includes/ folder

<?php
/*
---------- RollingCurlX 1.0.0 -----------
an easy to use curl_multi wrapper for php
License: MIT
https://github.com/marcushat/RollingCurlX
*/
Class RollingCurlX {
private $_maxConcurrent = 0; //max. number of simultaneous connections allowed
private $_options = []; //shared cURL options
private $_headers = []; //shared cURL request headers
private $_callback = NULL; //default callback
private $_timeout = 5000; //all requests must be completed by this time
public $requests = []; //request_queue
function __construct($max_concurrent = 10) {
$this->setMaxConcurrent($max_concurrent);
}
public function setMaxConcurrent($max_requests) {
if($max_requests > 0) {
$this->_maxConcurrent = $max_requests;
}
}
public function setOptions(array $options) {
$this->_options = $options;
}
public function setHeaders(array $headers) {
if(is_array($headers) && count($headers)) {
$this->_headers = $headers;
}
}
public function setCallback(callable $callback) {
$this->_callback = $callback;
}
public function setTimeout($timeout) { //in milliseconds
if($timeout > 0) {
$this->_timeout = $timeout/1000; //to seconds
}
}
//Add a request to the request queue
public function addRequest(
$url,
$post_data = NULL,
callable $callback = NULL, //individual callback
$user_data = NULL,
array $options = NULL, //individual cURL options
array $headers = NULL //individual cURL request headers
) { //Add to request queue
$this->requests[] = [
'url' => $url,
'post_data' => ($post_data) ? $post_data : NULL,
'callback' => ($callback) ? $callback : $this->_callback,
'user_data' => ($user_data) ? $user_data : NULL,
'options' => ($options) ? $options : NULL,
'headers' => ($headers) ? $headers : NULL
];
return count($this->requests) - 1; //return request number/index
}
//Reset request queue
public function reset() {
$this->requests = [];
}
private function normalize_headers(array $headers) {
$normalized = [];
foreach($headers as $key => $header) {
if(is_string($key)) {
$normal = "$key: $header";
} else {
$header;
}
$normalized = [];
}
}
//Execute the request queue
public function execute() {
if(count($this->requests) < $this->_maxConcurrent) {
$this->_maxConcurrent = count($this->requests);
}
//the request map that maps the request queue to request curl handles
$requests_map = [];
$multi_handle = curl_multi_init();
//start processing the initial request queue
for($i = 0; $i < $this->_maxConcurrent; $i++) {
$this->init_request($i, $multi_handle, $requests_map);
}
do{
do{
$mh_status = curl_multi_exec($multi_handle, $active);
} while($mh_status == CURLM_CALL_MULTI_PERFORM);
if($mh_status != CURLM_OK) {
break;
}
//a request is just completed, find out which one
while($completed = curl_multi_info_read($multi_handle)) {
$this->process_request($completed, $multi_handle, $requests_map);
//add/start a new request to the request queue
if($i < count($this->requests) && isset($this->requests[$i])) { //if requests left
$this->init_request($i, $multi_handle, $requests_map);
$i++;
}
}
usleep(15); //save CPU cycles, prevent continuous checking
} while ($active || count($requests_map)); //End do-while
$this->reset();
curl_multi_close($multi_handle);
}
//Build individual cURL options for a request
private function buildOptions(array $request) {
$url = $request['url'];
$post_data = $request['post_data'];
$individual_opts = $request['options'];
$individual_headers = $request['headers'];
$options = ($individual_opts) ? $individual_opts + $this->_options : $this->_options; //merge shared and individual request options
$headers = ($individual_headers) ? $individual_headers + $this->_headers : $this->_headers; //merge shared and individual request headers
//the below will overide the corresponding default or individual options
$options[CURLOPT_RETURNTRANSFER] = true;
$options[CURLOPT_NOSIGNAL] = 1;
$options[CURLOPT_CONNECTTIMEOUT] = max(1, $this->_timeout/1000); //minimum of 1 second
$options[CURLOPT_TIMEOUT] = $this->_timeout/1000;
if($url) {
$options[CURLOPT_URL] = $url;
}
if($headers) {
$options[CURLOPT_HTTPHEADER] = $headers;
}
// enable POST method and set POST parameters
if($post_data) {
$options[CURLOPT_POST] = 1;
$options[CURLOPT_POSTFIELDS] = is_array($post_data)? http_build_query($post_data) : $post_data;
}
return $options;
}
private function init_request($request_num, $multi_handle, &$requests_map) {
$request =& $this->requests[$request_num];
$this->addTimer($request);
$ch = curl_init();
$opts_set = curl_setopt_array($ch, $this->buildOptions($request));
if(!$opts_set) {
echo 'options not set';
exit;
}
curl_multi_add_handle($multi_handle, $ch);
//add curl handle of a new request to the request map
$ch_hash = (string) $ch;
$requests_map[$ch_hash] = $request_num;
}
private function process_request($completed, $multi_handle, array &$requests_map) {
$ch = $completed['handle'];
$ch_hash = (string) $ch;
$request =& $this->requests[$requests_map[$ch_hash]]; //map handler to request index to get request info
$request_info = curl_getinfo($ch);
$request_info['curle'] = $completed['result'];
$request_info['curle_msg'] = $this->curle_msgs[$completed['result']];
$request_info['handle'] = $ch;
$request_info['time'] = $time = $this->stopTimer($request); //record request time
$request_info['url_raw'] = $url = $request['url'];
$request_info['user_data'] = $user_data = $request['user_data'];
if(curl_errno($ch) !== 0 || intval($request_info['http_code']) !== 200) { //if server responded with http error
$response = false;
} else { //sucessful response
$response = curl_multi_getcontent($ch);
}
//get request info
$callback = $request['callback'];
$options = $request['options'];
if($response && (isset($this->_options[CURLOPT_HEADER]) || isset($options[CURLOPT_HEADER]))) {
$k = intval($request_info['header_size']);
$request_info['response_header'] = substr($response, 0, $k);
$response = substr($response, $k);
}
//remove completed request and its curl handle
unset($requests_map[$ch_hash]);
curl_multi_remove_handle($multi_handle, $ch);
//call the callback function and pass request info and user data to it
if($callback) {
call_user_func($callback, $response, $url, $request_info, $user_data, $time);
}
$request = NULL; //free up memory now just incase response was large
}
private function check_for_timeouts($mh) {
$now = microtime($true);
$request_map = $this->_request_map;
$requests = $this->_request_map;
foreach($request_maps as $ch_hash => $request_num) {
$request = $requests[$request_num];
$timeout = $request->timeout;
$start_time = $request->start_time;
$ch = $request->handle;
if($now >= $start_time + $timeout) {
curl_multi_remove_handle($mh, $ch);
}
}
}
private function addTimer(array &$request) { //adds timer object to request
$request['timer'] = microtime(true);
$request['time'] = false; //default if not overridden by time later
}
private function stopTimer(array &$request) {
$elapsed = $request['time'] = microtime(true) - $request['timer'];
unset($request['timer']);
return $elapsed;
}
private $curle_msgs = [CURLE_OK => 'OK', CURLE_UNSUPPORTED_PROTOCOL => 'UNSUPPORTED_PROTOCOL', CURLE_FAILED_INIT => 'FAILED_INIT', CURLE_URL_MALFORMAT => 'URL_MALFORMAT', CURLE_URL_MALFORMAT_USER => 'URL_MALFORMAT_USER', CURLE_COULDNT_RESOLVE_PROXY => 'COULDNT_RESOLVE_PROXY', CURLE_COULDNT_RESOLVE_HOST => 'COULDNT_RESOLVE_HOST', CURLE_COULDNT_CONNECT => 'COULDNT_CONNECT', CURLE_FTP_WEIRD_SERVER_REPLY => 'FTP_WEIRD_SERVER_REPLY', CURLE_FTP_ACCESS_DENIED => 'FTP_ACCESS_DENIED', CURLE_FTP_USER_PASSWORD_INCORRECT => 'FTP_USER_PASSWORD_INCORRECT', CURLE_FTP_WEIRD_PASS_REPLY => 'FTP_WEIRD_PASS_REPLY', CURLE_FTP_WEIRD_USER_REPLY => 'FTP_WEIRD_USER_REPLY', CURLE_FTP_WEIRD_PASV_REPLY => 'FTP_WEIRD_PASV_REPLY', CURLE_FTP_WEIRD_227_FORMAT => 'FTP_WEIRD_227_FORMAT', CURLE_FTP_CANT_GET_HOST => 'FTP_CANT_GET_HOST', CURLE_FTP_CANT_RECONNECT => 'FTP_CANT_RECONNECT', CURLE_FTP_COULDNT_SET_BINARY => 'FTP_COULDNT_SET_BINARY', CURLE_PARTIAL_FILE => 'PARTIAL_FILE', CURLE_FTP_COULDNT_RETR_FILE => 'FTP_COULDNT_RETR_FILE', CURLE_FTP_WRITE_ERROR => 'FTP_WRITE_ERROR', CURLE_FTP_QUOTE_ERROR => 'FTP_QUOTE_ERROR', CURLE_HTTP_NOT_FOUND => 'HTTP_NOT_FOUND', CURLE_WRITE_ERROR => 'WRITE_ERROR', CURLE_MALFORMAT_USER => 'MALFORMAT_USER', CURLE_FTP_COULDNT_STOR_FILE => 'FTP_COULDNT_STOR_FILE', CURLE_READ_ERROR => 'READ_ERROR', CURLE_OUT_OF_MEMORY => 'OUT_OF_MEMORY', CURLE_OPERATION_TIMEOUTED => 'OPERATION_TIMEOUTED', CURLE_FTP_COULDNT_SET_ASCII => 'FTP_COULDNT_SET_ASCII', CURLE_FTP_PORT_FAILED => 'FTP_PORT_FAILED', CURLE_FTP_COULDNT_USE_REST => 'FTP_COULDNT_USE_REST', CURLE_FTP_COULDNT_GET_SIZE => 'FTP_COULDNT_GET_SIZE', CURLE_HTTP_RANGE_ERROR => 'HTTP_RANGE_ERROR', CURLE_HTTP_POST_ERROR => 'HTTP_POST_ERROR', CURLE_SSL_CONNECT_ERROR => 'SSL_CONNECT_ERROR', CURLE_FTP_BAD_DOWNLOAD_RESUME => 'FTP_BAD_DOWNLOAD_RESUME', CURLE_FILE_COULDNT_READ_FILE => 'FILE_COULDNT_READ_FILE', CURLE_LDAP_CANNOT_BIND => 'LDAP_CANNOT_BIND', CURLE_LDAP_SEARCH_FAILED => 'LDAP_SEARCH_FAILED', CURLE_LIBRARY_NOT_FOUND => 'LIBRARY_NOT_FOUND', CURLE_FUNCTION_NOT_FOUND => 'FUNCTION_NOT_FOUND', CURLE_ABORTED_BY_CALLBACK => 'ABORTED_BY_CALLBACK', CURLE_BAD_FUNCTION_ARGUMENT => 'BAD_FUNCTION_ARGUMENT', CURLE_BAD_CALLING_ORDER => 'BAD_CALLING_ORDER', CURLE_HTTP_PORT_FAILED => 'HTTP_PORT_FAILED', CURLE_BAD_PASSWORD_ENTERED => 'BAD_PASSWORD_ENTERED', CURLE_TOO_MANY_REDIRECTS => 'TOO_MANY_REDIRECTS', CURLE_UNKNOWN_TELNET_OPTION => 'UNKNOWN_TELNET_OPTION', CURLE_TELNET_OPTION_SYNTAX => 'TELNET_OPTION_SYNTAX', CURLE_OBSOLETE => 'OBSOLETE', CURLE_SSL_PEER_CERTIFICATE => 'SSL_PEER_CERTIFICATE', CURLE_GOT_NOTHING => 'GOT_NOTHING', CURLE_SSL_ENGINE_NOTFOUND => 'SSL_ENGINE_NOTFOUND', CURLE_SSL_ENGINE_SETFAILED => 'SSL_ENGINE_SETFAILED', CURLE_SEND_ERROR => 'SEND_ERROR', CURLE_RECV_ERROR => 'RECV_ERROR', CURLE_SHARE_IN_USE => 'SHARE_IN_USE', CURLE_SSL_CERTPROBLEM => 'SSL_CERTPROBLEM', CURLE_SSL_CIPHER => 'SSL_CIPHER', CURLE_SSL_CACERT => 'SSL_CACERT', CURLE_BAD_CONTENT_ENCODING => 'BAD_CONTENT_ENCODING', CURLE_LDAP_INVALID_URL => 'LDAP_INVALID_URL', CURLE_FILESIZE_EXCEEDED => 'FILESIZE_EXCEEDED', CURLE_FTP_SSL_FAILED => 'FTP_SSL_FAILED', CURLE_SSH => 'SSH'
];
}
?>

Sao chép mã

4. Upload to PHP supported hosting server.
Download with command:
php instagram_dl.php <username>
5. Backup your instagram photos to the cloud.

temtem · Đăng lúc 26-9-2017 23:16:48

Trích xuất toàn bộ thông tin: userid, captions, likes của 1 tài khoản instagram
Extract all information of an account via:
https://www.instagram.com/instagram/?__a=1.
explore via tag
https://www.instagram.com/explore/tags/vietnam/?__a=1&max_id=600
via location
https://www.instagram.com/explore/locations/4021454/?__a=1
Dữ liệu trả về dạng JSON. Công việc kế tiếp là tìm công cụ chuyển từ json sang excel hay bất kỳ loại dữ liệu thô nào bạn muốn

Tài khoản		Ghi nhớ?	Quên mật khẩu
Mật khẩu			Register