0

我的网站上有一个 twitter 提要,它由 jquery 推文插件 tweet.seaofclouds.com 和其他一些从 3rd 方网站获取 json 提要的 json 插件提供支持。

问题是 twitter api 每小时只允许 150 个调用,因此每小时有 40 个访问者,平均每个访问者有 5 个页面浏览量,我远远超过了这个最大值。特别是因为 twitter 禁用了对提要的缓存。

此外,还有饼干法则问题。Twitter 在请求提要时丢弃 cookie,我不想要它们,因为它们需要有被丢弃的权限,所以我想一直禁用它们。

此外,我的网站是 SSL 安全的,我想加载尽可能少的外部资源,我希望它全部本地化。

如何在本地缓存这些 json 提要?

4

1 回答 1

2

对于这个问题,我编写了自己的数据库存储机制来存储 json 提要并在需要时获取它们并返回它们。这样我只需要每 5 分钟获取一次,而我获得的访问者/网页浏览量是无关紧要的。

这是mysql中的数据库创建代码

CREATE TABLE IF NOT EXISTS `twitterbackup` (
  `url` text NOT NULL,
  `tijd` int(11) NOT NULL,
  `inhoud` text NOT NULL,
  FULLTEXT KEY `url` (`url`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1;

然后在 PHP 中,我有一些安全检查的代码,因为你永远不知道你会得到什么

<?php
/* JSON Backup script written by Michael Dibbets
 * Copyright 2012 by Michael Dibbets
 * http://www.facebook.com/michael.dibbets - mdibbets[at]outlook.com
 * Licenced under the MIT license http://opensource.org/licenses/MIT
 */
// Basic sql injection protection.
// Using explode because str_replace fails to many times when certain character combinations exist. 
// Replace, remove as you see fit. This setup works for my server, and str_replace works on another. 
// Use whatever has your fancy
function protect($s)
    {
    $s = mysql_real_escape_string($s);
    $s = implode(" ",explode(";",$s));
    $s = implode(" ",explode("UNION",$s));
    $s = implode(" ",explode("BENCHMARK",$s));
    $s = implode(" ",explode("WAITFOR DELAY",$s));
    $s = implode(" ",explode("LOAD_FILE",$s));
    $s = implode(" ",explode("OUTFILE",$s));
    $s = implode(" ",explode("INFORMATION_SCHEMA",$s));
    $s = implode(" ",explode("Char(",$s));
    $s = implode(" ",explode("CAST(",$s));
    return $s;
    }
function get_data($url)
    {
    // Initialise data to have at least something to work with
    $data = "";
        // What time is it?
        $now = strtotime("now");
        // Connect to our database
        $db = mysqli_connect("localhost", "USERNAME", "PASSWORD", "DATABASE");
        if (mysqli_connect_errno($mysqli)) 
            {
            die("ARGH!");
            }
        // Basic protection agains sql injection by banning unsafe words
        $saveurl = protect($url);
        // Count how many times the url has been found.
        $count = $db->query("SELECT count(*) as counter FROM twitterbackup WHERE `url`='$saveurl'")->fetch_assoc();
        // Has the url been found?
        if($count['counter'] == 0)
            {
            // Fetch twitter json 
            $ch = curl_init();
            $timeout = 5;
            curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
            curl_setopt($ch,CURLOPT_URL,$url);
            curl_setopt($ch,CURLOPT_RETURNTRANSFER,1);
            curl_setopt($ch,CURLOPT_CONNECTTIMEOUT,$timeout);
            $data = curl_exec($ch);
            curl_close($ch);
            // make the json data database safe
            $data = str_replace('\\','\\\\',$data);
            $data = mysql_real_escape_string($data);
            //$data = mysql_real_escape_string($data);
            // Enter json data in the database
            $db->query("INSERT INTO `DATABASE`.`twitterbackup` (`url`, `tijd`, `inhoud`) VALUES ('$saveurl', '$now', '$data')");
            // End of we have not found the url
            }
        // If the URL has been found
        else
            {
            // get the values in the database that are connected to the url
            $res = $db->query("SELECT * FROM twitterbackup WHERE `url`='$saveurl'")->fetch_assoc();
            // Is the current json in database younger than five minutes?
            if((int)$res['tijd'] < (int)strtotime("-5 minutes"))
                {
                // Fetch twitter json with curl
                $ch = curl_init();
                $timeout = 5;
                curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
                curl_setopt($ch,CURLOPT_URL,$url);
                curl_setopt($ch,CURLOPT_RETURNTRANSFER,1);
                curl_setopt($ch,CURLOPT_CONNECTTIMEOUT,$timeout);
                $data = curl_exec($ch);
                curl_close($ch);
                // Make the json data safe for the database
                $data = str_replace('\\','\\\\',$data);
                $data = mysql_real_escape_string($data);
                // Update the database with the most recent feed
                $db->query("UPDATE  `DATABASE`.`twitterbackup` SET 
                            `tijd` =  '$now',
                            `inhoud` =  '$data' 
                            WHERE  `twitterbackup`.`url` =  '$saveurl'");
                // End if the url has been found and lifetime is older than five minutes
                }
            // If the lifetime isn't older then 5 minutes
            else
                {
                // return database content
                $data = $res['inhoud'];
                }
            // end of if we have found the url
            }
          // try to beat mysql_real_escape_string to return valid json. Always check valid json returend and edit this if it fails at some piece. Try http://jsonlint.com/
          $data = str_replace('\\"','"',$data);
          // implode because str_replace won't do everthing for some reason I can't understand.
          $data = implode('\\',explode('\\\\',$data));
          // Data retourneren
          return $data;
        // end check if it's from the twitter api
        }
// End of function get_data();
// How long may the json be cached by browser(to stop unneccesary requests in this case 5 minutes)
$seconds_to_cache = 5*60;
$ts = gmdate("D, d M Y H:i:s", time() + $seconds_to_cache) . " GMT";
header("Expires: $ts");
header("Pragma: cache");
header("Cache-Control: max-age=$seconds_to_cache");
header('Content-type: application/json');
echo get_data($_GET['url']);
?>

然后在 twitter.js 中,您只需替换 getJSON url 以指向您的本地服务器,如下所示(在 jquery.tweet.js 底部的某处,您会找到这一行)

寻找:$.getJSON(build_api_url()).success(function(data){

代替:

// For debug purposes
// console.log("/scripts/twitter/tweet/curlthispage.php?url="+encodeURIComponent(build_api_url()));
        $.getJSON("/scripts/twitter/tweet/curlthispage.php?url="+encodeURIComponent(build_api_url())).success(function(data){
于 2012-08-01T11:08:06.533 回答