0

第一的,

我进行了很多搜索以找到解决方案,但找不到合适的解决方案。

环境

  • (高效)Mongoose WebServer 回复简单的 GET 请求(所有数据都通过 QueryString 传输)
  • Apache HttpClient(单个实例!)用于按顺序发出数十万个单个请求。
  • Apache HttpClient 与 mongoose 交互效果很好

    // after each request
    getMethod.releaseConnection();
    ...
    

问题

  • (模拟)使用 Sun HttpServer 实现 WebServer 与 FireFox / Curl 配合使用
  • 使用 Apache HttpClient 和在生产服务器上运行一样,客户端的性能非常糟糕(~ 1 次请求/秒)
  • 使用 Apache HttpClient 并在网上找到以下代码导致
    • 客户端的巨大性能提升
    • 由于 CLOSE_WAIT 状态的打开套接字与处理的请求一样多,导致资源浪费(直到没有更多的 FD 可用!)

代码:

HttpConnectionManager mgr = httpClient.getHttpConnectionManager();
    if (mgr instanceof SimpleHttpConnectionManager) {
    ((SimpleHttpConnectionManager)mgr).shutdown();
}

显然我在http服务器实现中遗漏了一些东西,这导致了这种极端的“缓慢”

任何提示/帮助表示赞赏。

提前致谢!


代码

HttpServer

public static void main(String[] args) throws Exception {
        //System.setProperty("sun.net.httpserver.maxIdleConnections", "10");
        //System.setProperty("sun.net.httpserver.idleInterval", "2000");

        HttpServer server = HttpServer.create();

        server.bind(new InetSocketAddress("localhost", 11111), -1);
        InetSocketAddress addr = server.getAddress();
        HttpContext contextSearch = server.createContext("/search.to",
                new TrufflesSearchHandler());

        contextSearch.getFilters().add(new ParameterFilter());
        server.setExecutor(null); // creates a default executor
        server.start();
    }

HttpHandler

    static class SearchHandler implements HttpHandler {
        private JSONParser jsonParser = new JSONParser();

        public void handle(HttpExchange exchange) throws IOException {
            Map<String, Object> params = (Map<String, Object>) exchange
                    .getAttribute("parameters");
            String expectedResponse = "";
            int expectedHitPlace = -1;

            try {
                expectedResponse = (String) params.get("expectedResponse");
                expectedHitPlace = Integer.parseInt((String) params
                        .get("expectedHitPlace"));
            } catch (Exception e) {
                e.printStackTrace();
            }

            JSONArray resultArray = null;
            try {
                resultArray = (JSONArray) jsonParser.parse(new String(Base64
                        .decodeBase64(expectedResponse)));
                fillResponseWithDummyData(resultArray, expectedHitPlace);
            } catch (ParseException e) {
                e.printStackTrace();
            }
            String response = "{ \"results\": " + resultArray + "}";

            Headers headers = exchange.getResponseHeaders();
            headers.add("Connection", "keep-alive");
            headers.add("Content-Type", "text/plain");
            headers.add("Content-length", "" + response.getBytes().length);
            // headers.add("Keep-Alive", "timeout=5 max=10");
            exchange.sendResponseHeaders(200, 0);
            // exchange.sendResponseHeaders(200, response.getBytes().length);
            OutputStream os = exchange.getResponseBody();
            os.write(response.getBytes());
            os.flush();
            os.close();
            // exchange.close();
        }

参数过滤器

@SuppressWarnings("restriction")
public class ParameterFilter extends Filter {

    @Override
    public String description() {
        return "Parses the requested URI for parameters";
    }

    @Override
    public void doFilter(HttpExchange exchange, Chain chain)
        throws IOException {
        parseGetParameters(exchange);
        parsePostParameters(exchange);
        chain.doFilter(exchange);
    }    

    private void parseGetParameters(HttpExchange exchange)
        throws UnsupportedEncodingException {

        Map<String, Object> parameters = new HashMap<String, Object>();
        URI requestedUri = exchange.getRequestURI();
        String query = requestedUri.getRawQuery();
        parseQuery(query, parameters);
        exchange.setAttribute("parameters", parameters);
    }

    private void parsePostParameters(HttpExchange exchange)
        throws IOException {

        if ("post".equalsIgnoreCase(exchange.getRequestMethod())) {
            @SuppressWarnings("unchecked")
            Map<String, Object> parameters =
                (Map<String, Object>)exchange.getAttribute("parameters");
            InputStreamReader isr =
                new InputStreamReader(exchange.getRequestBody(),"utf-8");
            BufferedReader br = new BufferedReader(isr);
            String query = br.readLine();
            parseQuery(query, parameters);
        }
    }

     private void parseQuery(String query, Map<String, Object> parameters)
         throws UnsupportedEncodingException {
         String encoding = System.getProperty("file.encoding");
         if (query != null) {
             String pairs[] = query.split("[&]");

             for (String pair : pairs) {
                 String param[] = pair.split("[=]");

                 String key = null;
                 String value = null;
                 if (param.length > 0) {
                     key = URLDecoder.decode(param[0],
                         encoding);
                 }

                 if (param.length > 1) {
                     value = URLDecoder.decode(param[1],
                         encoding);
                 }

                 if (parameters.containsKey(key)) {
                     Object obj = parameters.get(key);
                     if(obj instanceof List<?>) {
                         List<String> values = (List<String>)obj;
                         values.add(value);
                     } else if(obj instanceof String) {
                         List<String> values = new ArrayList<String>();
                         values.add((String)obj);
                         values.add(value);
                         parameters.put(key, values);
                     }
                 } else {
                     parameters.put(key, value);
                 }
             }
         }
    }

}
4

0 回答 0