Profile of /usr/local/lib/perl5/site_perl/5.10.1/LWP/Protocol/http.pm

← Index
NYTProf Performance Profile «block view•line view•sub view»
For 01.HTTP.t
Run on Tue May 4 15:25:55 2010
Reported on Tue May 4 15:26:16 2010

File | /usr/local/lib/perl5/site_perl/5.10.1/LWP/Protocol/http.pm
Statements Executed | 539
Statement Execution Time | 179ms

Subroutines — ordered by exclusive time
Calls | P | F | Exclusive Time | Inclusive Time | Subroutine
--- | --- | --- | --- | --- | ---
8 | 1 | 2 | 174ms | 174ms | LWP::Protocol::http::SocketMethods::::CORE:sselectLWP::Protocol::http::SocketMethods::CORE:sselect (opcode)
1 | 1 | 1 | 1.96ms | 2.08ms | LWP::Protocol::http::::BEGIN@216 LWP::Protocol::http::BEGIN@216
3 | 1 | 1 | 1.09ms | 345ms | LWP::Protocol::http::::request LWP::Protocol::http::request
8 | 2 | 1 | 215µs | 174ms | LWP::Protocol::http::SocketMethods::::can_readLWP::Protocol::http::SocketMethods::can_read
7 | 2 | 1 | 141µs | 174ms | LWP::Protocol::http::SocketMethods::::sysreadLWP::Protocol::http::SocketMethods::sysread
3 | 1 | 1 | 136µs | 125ms | LWP::Protocol::http::::_new_socket LWP::Protocol::http::_new_socket
7 | 1 | 2 | 90µs | 90µs | LWP::Protocol::http::SocketMethods::::CORE:sysreadLWP::Protocol::http::SocketMethods::CORE:sysread (opcode)
7 | 2 | 1 | 82µs | 728µs | LWP::Protocol::http::::__ANON__[:394] LWP::Protocol::http::__ANON__[:394]
3 | 1 | 1 | 80µs | 586µs | LWP::Protocol::http::::_get_sock_info LWP::Protocol::http::_get_sock_info
9 | 1 | 1 | 77µs | 82µs | LWP::Protocol::http::::__ANON__[:167] LWP::Protocol::http::__ANON__[:167]
3 | 1 | 1 | 50µs | 192µs | LWP::Protocol::http::::_fixup_header LWP::Protocol::http::_fixup_header
15 | 5 | 2 | 30µs | 30µs | LWP::Protocol::http::::CORE:match LWP::Protocol::http::CORE:match (opcode)
3 | 1 | 2 | 27µs | 27µs | LWP::Protocol::http::::CORE:sselect LWP::Protocol::http::CORE:sselect (opcode)
1 | 1 | 1 | 22µs | 26µs | LWP::Protocol::http::::BEGIN@3 LWP::Protocol::http::BEGIN@3
5 | 2 | 1 | 15µs | 15µs | LWP::Protocol::http::::socket_type LWP::Protocol::http::socket_type
3 | 1 | 1 | 14µs | 14µs | LWP::Protocol::http::SocketMethods::::increment_response_countLWP::Protocol::http::SocketMethods::increment_response_count
1 | 1 | 1 | 12µs | 45µs | LWP::Protocol::http::Socket::::BEGIN@472 LWP::Protocol::http::Socket::BEGIN@472
1 | 1 | 1 | 11µs | 61µs | LWP::Protocol::http::::BEGIN@9 LWP::Protocol::http::BEGIN@9
21 | 3 | 2 | 9µs | 9µs | LWP::Protocol::http::::CORE:subst LWP::Protocol::http::CORE:subst (opcode)
2 | 1 | 1 | 8µs | 8µs | LWP::Protocol::http::::socket_class LWP::Protocol::http::socket_class
3 | 1 | 1 | 5µs | 5µs | LWP::Protocol::http::::_check_sock LWP::Protocol::http::_check_sock
2 | 1 | 1 | 4µs | 4µs | LWP::Protocol::http::::_extra_sock_opts LWP::Protocol::http::_extra_sock_opts
0 | 0 | 0 | 0s | 0s | LWP::Protocol::http::SocketMethods::::pingLWP::Protocol::http::SocketMethods::ping
0 | 0 | 0 | 0s | 0s | LWP::Protocol::http::::hlist_remove LWP::Protocol::http::hlist_remove

Call graph for these subroutines as a Graphviz dot language file.

Line | State ments | Time on line | Calls | Time in subs | Code
--- | --- | --- | --- | --- | ---
1 |  |  |  |  | package LWP::Protocol::http;
2 |  |  |  |  |
3 | 3 | 73µs | 2 | 31µs | # spent 26µs (22+5) within LWP::Protocol::http::BEGIN@3 which was called # once (22µs+5µs) by LWP::Protocol::implementor at line 3 use strict; # spent 26µs making 1 call to LWP::Protocol::http::BEGIN@3 # spent 5µs making 1 call to strict::import
4 |  |  |  |  |
5 | 1 | 900ns |  |  | require HTTP::Response;
6 | 1 | 800ns |  |  | require HTTP::Status;
7 | 1 | 98µs |  |  | require Net::HTTP;
8 |  |  |  |  |
9 | 3 | 1.43ms | 2 | 112µs | # spent 61µs (11+50) within LWP::Protocol::http::BEGIN@9 which was called # once (11µs+50µs) by LWP::Protocol::implementor at line 9 use vars qw(@ISA @EXTRA_SOCK_OPTS); # spent 61µs making 1 call to LWP::Protocol::http::BEGIN@9 # spent 50µs making 1 call to vars::import
10 |  |  |  |  |
11 | 1 | 1µs |  |  | require LWP::Protocol;
12 | 1 | 13µs |  |  | @ISA = qw(LWP::Protocol);
13 |  |  |  |  |
14 | 1 | 1µs |  |  | my $CRLF = "\015\012";
15 |  |  |  |  |
16 |  |  |  |  | sub _new_socket
17 |  |  |  |  | # spent 125ms (136µs+125) within LWP::Protocol::http::_new_socket which was called 3 times, avg 41.6ms/call: # 3 times (136µs+125ms) by LWP::Protocol::http::request at line 155, avg 41.6ms/call {
18 | 19 | 75µs |  |  | my($self, $host, $port, $timeout) = @_;
19 |  |  |  |  | my $conn_cache = $self->{ua}{conn_cache};
20 | 3 | 20µs |  |  | if ($conn_cache) {
21 | 1 | 7µs | 6 | 36µs | if (my $sock = $conn_cache->withdraw($self->socket_type, "$host:$port")) { # spent 30µs making 3 calls to LWP::ConnCache::withdraw, avg 10µs/call # spent 6µs making 3 calls to LWP::Protocol::http::socket_type, avg 2µs/call
22 |  |  |  |  | return $sock if $sock && !$sock->can_read(0); # spent 19µs making 1 call to LWP::Protocol::http::SocketMethods::can_read
23 |  |  |  |  | # if the socket is readable, then either the peer has closed the
24 |  |  |  |  | # connection or there are some garbage bytes on it. In either
25 |  |  |  |  | # case we abandon it.
26 |  |  |  |  | $sock->close;
27 |  |  |  |  | }
28 |  |  |  |  | }
29 |  |  |  |  |
30 |  |  |  |  | local($^W) = 0; # IO::Socket::INET can be noisy
31 |  |  |  |  | my $sock = $self->socket_class->new(PeerAddr => $host, # spent 124ms making 2 calls to Net::HTTP::new, avg 62.2ms/call # spent 8µs making 2 calls to LWP::Protocol::http::socket_class, avg 4µs/call # spent 4µs making 2 calls to LWP::Protocol::http::_extra_sock_opts, avg 2µs/call
32 |  |  |  |  | PeerPort => $port,
33 |  |  |  |  | LocalAddr => $self->{ua}{local_address},
34 |  |  |  |  | Proto => 'tcp',
35 |  |  |  |  | Timeout => $timeout,
36 |  |  |  |  | KeepAlive => !!$conn_cache,
37 |  |  |  |  | SendTE => 1,
38 |  |  |  |  | $self->_extra_sock_opts($host, $port),
39 |  |  |  |  | );
40 |  |  |  |  |
41 |  |  |  |  | unless ($sock) {
42 |  |  |  |  | # IO::Socket::INET leaves additional error messages in $@
43 |  |  |  |  | $@ =~ s/^.*?: //;
44 |  |  |  |  | die "Can't connect to $host:$port ($@)";
45 |  |  |  |  | }
46 |  |  |  |  |
47 |  |  |  |  | # perl 5.005's IO::Socket does not have the blocking method.
48 | 2 | 5µs | 2 | 23µs | eval { $sock->blocking(0); }; # spent 23µs making 2 calls to IO::Socket::blocking, avg 11µs/call
49 |  |  |  |  |
50 |  |  |  |  | $sock;
51 |  |  |  |  | }
52 |  |  |  |  |
53 |  |  |  |  | sub socket_type
54 |  |  |  |  | # spent 15µs within LWP::Protocol::http::socket_type which was called 5 times, avg 3µs/call: # 3 times (6µs+0s) by LWP::Protocol::http::_new_socket at line 21, avg 2µs/call # 2 times (9µs+0s) by LWP::Protocol::http::request at line 408, avg 5µs/call {
55 | 5 | 24µs |  |  | return "http";
56 |  |  |  |  | }
57 |  |  |  |  |
58 |  |  |  |  | sub socket_class
59 |  |  |  |  | # spent 8µs within LWP::Protocol::http::socket_class which was called 2 times, avg 4µs/call: # 2 times (8µs+0s) by LWP::Protocol::http::_new_socket at line 31, avg 4µs/call {
60 | 4 | 10µs |  |  | my $self = shift;
61 |  |  |  |  | (ref($self) || $self) . "::Socket";
62 |  |  |  |  | }
63 |  |  |  |  |
64 |  |  |  |  | sub _extra_sock_opts # to be overridden by subclass
65 |  |  |  |  | # spent 4µs within LWP::Protocol::http::_extra_sock_opts which was called 2 times, avg 2µs/call: # 2 times (4µs+0s) by LWP::Protocol::http::_new_socket at line 31, avg 2µs/call {
66 | 2 | 7µs |  |  | return @EXTRA_SOCK_OPTS;
67 |  |  |  |  | }
68 |  |  |  |  |
69 |  |  |  |  | sub _check_sock
70 | 3 | 9µs |  |  | # spent 5µs within LWP::Protocol::http::_check_sock which was called 3 times, avg 2µs/call: # 3 times (5µs+0s) by LWP::Protocol::http::request at line 156, avg 2µs/call {
71 |  |  |  |  | #my($self, $req, $sock) = @_;
72 |  |  |  |  | }
73 |  |  |  |  |
74 |  |  |  |  | sub _get_sock_info
75 |  |  |  |  | # spent 586µs (80+506) within LWP::Protocol::http::_get_sock_info which was called 3 times, avg 195µs/call: # 3 times (80µs+506µs) by LWP::Protocol::http::request at line 367, avg 195µs/call {
76 | 6 | 67µs |  |  | my($self, $res, $sock) = @_;
77 |  |  |  |  | if (defined(my $peerhost = $sock->peerhost)) { # spent 231µs making 3 calls to IO::Socket::INET::peerhost, avg 77µs/call # spent 104µs making 2 calls to HTTP::Message::__ANON__[HTTP/Message.pm:622], avg 52µs/call # spent 64µs making 3 calls to IO::Socket::INET::peerport, avg 21µs/call # spent 13µs making 1 call to HTTP::Message::AUTOLOAD
78 |  |  |  |  | $res->header("Client-Peer" => "$peerhost:" . $sock->peerport);
79 |  |  |  |  | }
80 |  |  |  |  | }
81 |  |  |  |  |
82 |  |  |  |  | sub _fixup_header
83 |  |  |  |  | # spent 192µs (50+142) within LWP::Protocol::http::_fixup_header which was called 3 times, avg 64µs/call: # 3 times (50µs+142µs) by LWP::Protocol::http::request at line 160, avg 64µs/call {
84 | 15 | 49µs |  |  | my($self, $h, $url, $proxy) = @_;
85 |  |  |  |  |
86 |  |  |  |  | # Extract 'Host' header
87 |  |  |  |  | my $hhost = $url->authority; # spent 58µs making 3 calls to URI::_generic::authority, avg 19µs/call
88 |  |  |  |  | if ($hhost =~ s/^([^\@]*)\@//) { # get rid of potential "user:pass@" # spent 3µs making 3 calls to LWP::Protocol::http::CORE:subst, avg 1µs/call
89 |  |  |  |  | # add authorization header if we need them. HTTP URLs do
90 |  |  |  |  | # not really support specification of user and password, but
91 |  |  |  |  | # we allow it.
92 |  |  |  |  | if (defined($1) && not $h->header('Authorization')) {
93 |  |  |  |  | require URI::Escape;
94 |  |  |  |  | $h->authorization_basic(map URI::Escape::uri_unescape($_),
95 |  |  |  |  | split(":", $1, 2));
96 |  |  |  |  | }
97 |  |  |  |  | }
98 |  |  |  |  | $h->init_header('Host' => $hhost); # spent 81µs making 3 calls to HTTP::Headers::init_header, avg 27µs/call
99 |  |  |  |  |
100 |  |  |  |  | if ($proxy) {
101 |  |  |  |  | # Check the proxy URI's userinfo() for proxy credentials
102 |  |  |  |  | # export http_proxy="http://proxyuser:proxypass@proxyhost:port"
103 |  |  |  |  | my $p_auth = $proxy->userinfo();
104 |  |  |  |  | if(defined $p_auth) {
105 |  |  |  |  | require URI::Escape;
106 |  |  |  |  | $h->proxy_authorization_basic(map URI::Escape::uri_unescape($_),
107 |  |  |  |  | split(":", $p_auth, 2))
108 |  |  |  |  | }
109 |  |  |  |  | }
110 |  |  |  |  | }
111 |  |  |  |  |
112 |  |  |  |  | sub hlist_remove {
113 |  |  |  |  | my($hlist, $k) = @_;
114 |  |  |  |  | $k = lc $k;
115 |  |  |  |  | for (my $i = @$hlist - 2; $i >= 0; $i -= 2) {
116 |  |  |  |  | next unless lc($hlist->[$i]) eq $k;
117 |  |  |  |  | splice(@$hlist, $i, 2);
118 |  |  |  |  | }
119 |  |  |  |  | }
120 |  |  |  |  |
121 |  |  |  |  | sub request
122 |  |  |  |  | # spent 345ms (1.09+344) within LWP::Protocol::http::request which was called 3 times, avg 115ms/call: # 3 times (1.09ms+344ms) by LWP::UserAgent::send_request at line 178 of LWP/UserAgent.pm, avg 115ms/call {
123 | 132 | 922µs |  |  | my($self, $request, $proxy, $arg, $size, $timeout) = @_;
124 |  |  |  |  |
125 |  |  |  |  | $size ||= 4096;
126 |  |  |  |  |
127 |  |  |  |  | # check method
128 |  |  |  |  | my $method = $request->method; # spent 26µs making 3 calls to HTTP::Request::method, avg 9µs/call
129 |  |  |  |  | unless ($method =~ /^[A-Za-z0-9_!\#\$%&\'*+\-.^\`|~]+$/) { # HTTP token # spent 17µs making 3 calls to LWP::Protocol::http::CORE:match, avg 6µs/call
130 |  |  |  |  | return new HTTP::Response &HTTP::Status::RC_BAD_REQUEST,
131 |  |  |  |  | 'Library does not allow method ' .
132 |  |  |  |  | "$method for 'http:' URLs";
133 |  |  |  |  | }
134 |  |  |  |  |
135 |  |  |  |  | my $url = $request->uri; # spent 9µs making 3 calls to HTTP::Request::uri, avg 3µs/call
136 |  |  |  |  | my($host, $port, $fullpath);
137 |  |  |  |  |
138 |  |  |  |  | # Check if we're proxy'ing
139 | 12 | 49µs |  |  | if (defined $proxy) {
140 |  |  |  |  | # $proxy is an URL to an HTTP server which will proxy this request
141 |  |  |  |  | $host = $proxy->host;
142 |  |  |  |  | $port = $proxy->port;
143 |  |  |  |  | $fullpath = $method eq "CONNECT" ?
144 |  |  |  |  | ($url->host . ":" . $url->port) :
145 |  |  |  |  | $url->as_string;
146 |  |  |  |  | }
147 |  |  |  |  | else {
148 |  |  |  |  | $host = $url->host; # spent 109µs making 3 calls to URI::_server::host, avg 36µs/call
149 |  |  |  |  | $port = $url->port; # spent 86µs making 3 calls to URI::_server::port, avg 29µs/call
150 |  |  |  |  | $fullpath = $url->path_query; # spent 30µs making 3 calls to URI::_generic::path_query, avg 10µs/call
151 |  |  |  |  | $fullpath = "/$fullpath" unless $fullpath =~ m,^/,; # spent 4µs making 3 calls to LWP::Protocol::http::CORE:match, avg 1µs/call
152 |  |  |  |  | }
153 |  |  |  |  |
154 |  |  |  |  | # connect to remote site
155 |  |  |  |  | my $socket = $self->_new_socket($host, $port, $timeout); # spent 125ms making 3 calls to LWP::Protocol::http::_new_socket, avg 41.6ms/call
156 |  |  |  |  | $self->_check_sock($request, $socket); # spent 5µs making 3 calls to LWP::Protocol::http::_check_sock, avg 2µs/call
157 |  |  |  |  |
158 |  |  |  |  | my @h;
159 |  |  |  |  | my $request_headers = $request->headers->clone; # spent 297µs making 3 calls to Storable::dclone, avg 99µs/call # spent 13µs making 3 calls to HTTP::Message::headers, avg 4µs/call
160 |  |  |  |  | $self->_fixup_header($request_headers, $url, $proxy); # spent 192µs making 3 calls to LWP::Protocol::http::_fixup_header, avg 64µs/call
161 |  |  |  |  |
162 |  |  |  |  | # spent 82µs (77+6) within LWP::Protocol::http::__ANON__[/usr/local/lib/perl5/site_perl/5.10.1/LWP/Protocol/http.pm:167] which was called 9 times, avg 9µs/call: # 9 times (77µs+6µs) by HTTP::Headers::scan at line 231 of HTTP/Headers.pm, avg 9µs/call $request_headers->scan(sub {
163 | 36 | 92µs |  |  | my($k, $v) = @_;
164 |  |  |  |  | $k =~ s/^://; # spent 3µs making 9 calls to LWP::Protocol::http::CORE:subst, avg 344ns/call
165 |  |  |  |  | $v =~ s/\n/ /g; # spent 3µs making 9 calls to LWP::Protocol::http::CORE:subst, avg 311ns/call
166 |  |  |  |  | push(@h, $k, $v);
167 |  |  |  |  | }); # spent 226µs making 3 calls to HTTP::Headers::scan, avg 75µs/call
168 |  |  |  |  |
169 |  |  |  |  | my $content_ref = $request->content_ref; # spent 25µs making 3 calls to HTTP::Message::content_ref, avg 8µs/call
170 |  |  |  |  | $content_ref = $$content_ref if ref($$content_ref);
171 |  |  |  |  | my $chunked;
172 |  |  |  |  | my $has_content;
173 |  |  |  |  |
174 | 6 | 14µs |  |  | if (ref($content_ref) eq 'CODE') {
175 |  |  |  |  | my $clen = $request_headers->header('Content-Length');
176 |  |  |  |  | $has_content++ if $clen;
177 |  |  |  |  | unless (defined $clen) {
178 |  |  |  |  | push(@h, "Transfer-Encoding" => "chunked");
179 |  |  |  |  | $has_content++;
180 |  |  |  |  | $chunked++;
181 |  |  |  |  | }
182 |  |  |  |  | }
183 |  |  |  |  | else {
184 |  |  |  |  | # Set (or override) Content-Length header
185 |  |  |  |  | my $clen = $request_headers->header('Content-Length'); # spent 62µs making 3 calls to HTTP::Headers::header, avg 21µs/call
186 | 6 | 4µs |  |  | if (defined($$content_ref) && length($$content_ref)) {
187 |  |  |  |  | $has_content = length($$content_ref);
188 | 6 | 5µs |  |  | if (!defined($clen) || $clen ne $has_content) {
189 |  |  |  |  | if (defined $clen) {
190 |  |  |  |  | warn "Content-Length header value was wrong, fixed";
191 |  |  |  |  | hlist_remove(\@h, 'Content-Length');
192 |  |  |  |  | }
193 |  |  |  |  | push(@h, 'Content-Length' => $has_content);
194 |  |  |  |  | }
195 |  |  |  |  | }
196 |  |  |  |  | elsif ($clen) {
197 |  |  |  |  | warn "Content-Length set when there is no content, fixed";
198 |  |  |  |  | hlist_remove(\@h, 'Content-Length');
199 |  |  |  |  | }
200 |  |  |  |  | }
201 |  |  |  |  |
202 |  |  |  |  | my $write_wait = 0;
203 |  |  |  |  | $write_wait = 2 # spent 44µs making 3 calls to HTTP::Headers::header, avg 15µs/call # spent 900ns making 3 calls to LWP::Protocol::http::CORE:match, avg 300ns/call
204 |  |  |  |  | if ($request_headers->header("Expect") || "") =~ /100-continue/;
205 |  |  |  |  |
206 |  |  |  |  | my $req_buf = $socket->format_request($method, $fullpath, @h); # spent 37.9ms making 3 calls to Net::HTTP::Methods::format_request, avg 12.6ms/call
207 |  |  |  |  | #print "------\n$req_buf\n------\n";
208 |  |  |  |  |
209 |  |  |  |  | if (!$has_content || $write_wait || $has_content > 8*1024) {
210 |  |  |  |  | WRITE:
211 |  |  |  |  | {
212 |  |  |  |  | # Since this just writes out the header block it should almost
213 |  |  |  |  | # always succeed to send the whole buffer in a single write call.
214 |  |  |  |  | my $n = $socket->syswrite($req_buf, length($req_buf));
215 |  |  |  |  | unless (defined $n) {
216 | 3 | 1.49ms | 1 | 2.08ms | # spent 2.08ms (1.96+126µs) within LWP::Protocol::http::BEGIN@216 which was called # once (1.96ms+126µs) by LWP::Protocol::implementor at line 216 redo WRITE if $!{EINTR}; # spent 2.08ms making 1 call to LWP::Protocol::http::BEGIN@216
217 |  |  |  |  | if ($!{EAGAIN}) {
218 |  |  |  |  | select(undef, undef, undef, 0.1);
219 |  |  |  |  | redo WRITE;
220 |  |  |  |  | }
221 |  |  |  |  | die "write failed: $!";
222 |  |  |  |  | }
223 |  |  |  |  | if ($n) {
224 |  |  |  |  | substr($req_buf, 0, $n, "");
225 |  |  |  |  | }
226 |  |  |  |  | else {
227 |  |  |  |  | select(undef, undef, undef, 0.5);
228 |  |  |  |  | }
229 |  |  |  |  | redo WRITE if length $req_buf;
230 |  |  |  |  | }
231 |  |  |  |  | }
232 |  |  |  |  |
233 |  |  |  |  | my($code, $mess, @junk);
234 |  |  |  |  | my $drop_connection;
235 |  |  |  |  |
236 | 21 | 24µs |  |  | if ($has_content) {
237 |  |  |  |  | my $eof;
238 |  |  |  |  | my $wbuf;
239 |  |  |  |  | my $woffset = 0;
240 | 6 | 3µs |  |  | if (ref($content_ref) eq 'CODE') {
241 |  |  |  |  | my $buf = &$content_ref();
242 |  |  |  |  | $buf = "" unless defined($buf);
243 |  |  |  |  | $buf = sprintf "%x%s%s%s", length($buf), $CRLF, $buf, $CRLF
244 |  |  |  |  | if $chunked;
245 |  |  |  |  | substr($buf, 0, 0) = $req_buf if $req_buf;
246 |  |  |  |  | $wbuf = \$buf;
247 |  |  |  |  | }
248 |  |  |  |  | else {
249 | 6 | 12µs |  |  | if ($req_buf) {
250 |  |  |  |  | my $buf = $req_buf . $$content_ref;
251 |  |  |  |  | $wbuf = \$buf;
252 |  |  |  |  | }
253 |  |  |  |  | else {
254 |  |  |  |  | $wbuf = $content_ref;
255 |  |  |  |  | }
256 |  |  |  |  | $eof = 1;
257 |  |  |  |  | }
258 |  |  |  |  |
259 |  |  |  |  | my $fbits = '';
260 |  |  |  |  | vec($fbits, fileno($socket), 1) = 1;
261 |  |  |  |  |
262 |  |  |  |  | WRITE:
263 |  |  |  |  | while ($woffset < length($$wbuf)) {
264 |  |  |  |  |
265 | 33 | 46µs |  |  | my $sel_timeout = $timeout;
266 |  |  |  |  | if ($write_wait) {
267 |  |  |  |  | $sel_timeout = $write_wait if $write_wait < $sel_timeout;
268 |  |  |  |  | }
269 |  |  |  |  | my $time_before;
270 |  |  |  |  | $time_before = time if $sel_timeout;
271 |  |  |  |  |
272 |  |  |  |  | my $rbits = $fbits;
273 |  |  |  |  | my $wbits = $write_wait ? undef : $fbits;
274 |  |  |  |  | my $sel_timeout_before = $sel_timeout;
275 | 6 | 45µs | 3 | 27µs | SELECT: # spent 27µs making 3 calls to LWP::Protocol::http::CORE:sselect, avg 9µs/call
276 |  |  |  |  | {
277 |  |  |  |  | my $nfound = select($rbits, $wbits, undef, $sel_timeout);
278 |  |  |  |  | if ($nfound < 0) {
279 |  |  |  |  | if ($!{EINTR} || $!{EAGAIN}) {
280 |  |  |  |  | if ($time_before) {
281 |  |  |  |  | $sel_timeout = $sel_timeout_before - (time - $time_before);
282 |  |  |  |  | $sel_timeout = 0 if $sel_timeout < 0;
283 |  |  |  |  | }
284 |  |  |  |  | redo SELECT;
285 |  |  |  |  | }
286 |  |  |  |  | die "select failed: $!";
287 |  |  |  |  | }
288 |  |  |  |  | }
289 |  |  |  |  |
290 |  |  |  |  | if ($write_wait) {
291 |  |  |  |  | $write_wait -= time - $time_before;
292 |  |  |  |  | $write_wait = 0 if $write_wait < 0;
293 |  |  |  |  | }
294 |  |  |  |  |
295 |  |  |  |  | if (defined($rbits) && $rbits =~ /[^\0]/) { # spent 4µs making 3 calls to LWP::Protocol::http::CORE:match, avg 1µs/call
296 |  |  |  |  | # readable
297 |  |  |  |  | my $buf = $socket->_rbuf;
298 |  |  |  |  | my $n = $socket->sysread($buf, 1024, length($buf));
299 |  |  |  |  | unless (defined $n) {
300 |  |  |  |  | die "read failed: $!" unless $!{EINTR} || $!{EAGAIN};
301 |  |  |  |  | # if we get here the rest of the block will do nothing
302 |  |  |  |  | # and we will retry the read on the next round
303 |  |  |  |  | }
304 |  |  |  |  | elsif ($n == 0) {
305 |  |  |  |  | # the server closed the connection before we finished
306 |  |  |  |  | # writing all the request content. No need to write any more.
307 |  |  |  |  | $drop_connection++;
308 |  |  |  |  | last WRITE;
309 |  |  |  |  | }
310 |  |  |  |  | $socket->_rbuf($buf);
311 |  |  |  |  | if (!$code && $buf =~ /\015?\012\015?\012/) {
312 |  |  |  |  | # a whole response header is present, so we can read it without blocking
313 |  |  |  |  | ($code, $mess, @h) = $socket->read_response_headers(laxed => 1,
314 |  |  |  |  | junk_out => \@junk,
315 |  |  |  |  | );
316 |  |  |  |  | if ($code eq "100") {
317 |  |  |  |  | $write_wait = 0;
318 |  |  |  |  | undef($code);
319 |  |  |  |  | }
320 |  |  |  |  | else {
321 |  |  |  |  | $drop_connection++;
322 |  |  |  |  | last WRITE;
323 |  |  |  |  | # XXX should perhaps try to abort write in a nice way too
324 |  |  |  |  | }
325 |  |  |  |  | }
326 |  |  |  |  | }
327 | 12 | 34µs | 3 | 4µs | if (defined($wbits) && $wbits =~ /[^\0]/) { # spent 4µs making 3 calls to LWP::Protocol::http::CORE:match, avg 1µs/call
328 |  |  |  |  | my $n = $socket->syswrite($$wbuf, length($$wbuf), $woffset); # spent 204µs making 3 calls to IO::Handle::syswrite, avg 68µs/call
329 |  |  |  |  | unless (defined $n) {
330 |  |  |  |  | die "write failed: $!" unless $!{EINTR} || $!{EAGAIN};
331 |  |  |  |  | $n = 0; # will retry write on the next round
332 |  |  |  |  | }
333 |  |  |  |  | elsif ($n == 0) {
334 |  |  |  |  | die "write failed: no bytes written";
335 |  |  |  |  | }
336 |  |  |  |  | $woffset += $n;
337 |  |  |  |  |
338 |  |  |  |  | if (!$eof && $woffset >= length($$wbuf)) {
339 |  |  |  |  | # need to refill buffer from $content_ref code
340 |  |  |  |  | my $buf = &$content_ref();
341 |  |  |  |  | $buf = "" unless defined($buf);
342 |  |  |  |  | $eof++ unless length($buf);
343 |  |  |  |  | $buf = sprintf "%x%s%s%s", length($buf), $CRLF, $buf, $CRLF
344 |  |  |  |  | if $chunked;
345 |  |  |  |  | $wbuf = \$buf;
346 |  |  |  |  | $woffset = 0;
347 |  |  |  |  | }
348 |  |  |  |  | }
349 |  |  |  |  | } # WRITE
350 |  |  |  |  | }
351 |  |  |  |  |
352 |  |  |  |  | ($code, $mess, @h) = $socket->read_response_headers(laxed => 1, junk_out => \@junk) # spent 175ms making 3 calls to Net::HTTP::Methods::read_response_headers, avg 58.4ms/call
353 |  |  |  |  | unless $code;
354 |  |  |  |  | ($code, $mess, @h) = $socket->read_response_headers(laxed => 1, junk_out => \@junk)
355 |  |  |  |  | if $code eq "100";
356 |  |  |  |  |
357 |  |  |  |  | my $response = HTTP::Response->new($code, $mess); # spent 314µs making 3 calls to HTTP::Response::new, avg 105µs/call
358 |  |  |  |  | my $peer_http_version = $socket->peer_http_version; # spent 18µs making 3 calls to Net::HTTP::Methods::__ANON__[Net/HTTP/Methods.pm:104], avg 6µs/call
359 |  |  |  |  | $response->protocol("HTTP/$peer_http_version"); # spent 32µs making 3 calls to HTTP::Message::protocol, avg 11µs/call
360 |  |  |  |  | {
361 | 6 | 28µs |  |  | local $HTTP::Headers::TRANSLATE_UNDERSCORE;
362 |  |  |  |  | $response->push_header(@h); # spent 184µs making 2 calls to HTTP::Message::__ANON__[HTTP/Message.pm:622], avg 92µs/call # spent 28µs making 1 call to HTTP::Message::AUTOLOAD
363 |  |  |  |  | }
364 |  |  |  |  | $response->push_header("Client-Junk" => \@junk) if @junk;
365 |  |  |  |  |
366 |  |  |  |  | $response->request($request); # spent 35µs making 3 calls to HTTP::Response::request, avg 12µs/call
367 |  |  |  |  | $self->_get_sock_info($response, $socket); # spent 586µs making 3 calls to LWP::Protocol::http::_get_sock_info, avg 195µs/call
368 |  |  |  |  |
369 |  |  |  |  | if ($method eq "CONNECT") {
370 |  |  |  |  | $response->{client_socket} = $socket; # so it can be picked up
371 |  |  |  |  | return $response;
372 |  |  |  |  | }
373 |  |  |  |  |
374 |  |  |  |  | if (my @te = $response->remove_header('Transfer-Encoding')) { # spent 143µs making 4 calls to HTTP::Message::__ANON__[HTTP/Message.pm:622], avg 36µs/call # spent 13µs making 1 call to HTTP::Message::AUTOLOAD
375 |  |  |  |  | $response->push_header('Client-Transfer-Encoding', \@te);
376 |  |  |  |  | }
377 |  |  |  |  | $response->push_header('Client-Response-Num', scalar $socket->increment_response_count); # spent 110µs making 3 calls to HTTP::Message::__ANON__[HTTP/Message.pm:622], avg 37µs/call # spent 14µs making 3 calls to LWP::Protocol::http::SocketMethods::increment_response_count, avg 5µs/call
378 |  |  |  |  |
379 |  |  |  |  | my $complete;
380 |  |  |  |  | # spent 728µs (82+646) within LWP::Protocol::http::__ANON__[/usr/local/lib/perl5/site_perl/5.10.1/LWP/Protocol/http.pm:394] which was called 7 times, avg 104µs/call: # 4 times (32µs+408µs) by LWP::Protocol::collect at line 158 of LWP/Protocol.pm, avg 110µs/call # 3 times (50µs+238µs) by LWP::Protocol::collect at line 148 of LWP/Protocol.pm, avg 96µs/call $response = $self->collect($arg, $response, sub {
381 | 35 | 42µs |  |  | my $buf = ""; #prevent use of uninitialized value in SSLeay.xs
382 |  |  |  |  | my $n;
383 | 21 | 39µs | 7 | 646µs | READ: # spent 646µs making 7 calls to Net::HTTP::Methods::read_entity_body, avg 92µs/call
384 |  |  |  |  | {
385 |  |  |  |  | $n = $socket->read_entity_body($buf, $size);
386 |  |  |  |  | unless (defined $n) {
387 |  |  |  |  | redo READ if $!{EINTR} || $!{EAGAIN};
388 |  |  |  |  | die "read failed: $!";
389 |  |  |  |  | }
390 |  |  |  |  | redo READ if $n == -1;
391 |  |  |  |  | }
392 |  |  |  |  | $complete++ if !$n;
393 |  |  |  |  | return \$buf;
394 |  |  |  |  | } ); # spent 2.84ms making 3 calls to LWP::Protocol::collect, avg 945µs/call
395 |  |  |  |  | $drop_connection++ unless $complete;
396 |  |  |  |  |
397 |  |  |  |  | @h = $socket->get_trailers; # spent 14µs making 3 calls to Net::HTTP::Methods::get_trailers, avg 5µs/call
398 |  |  |  |  | if (@h) {
399 |  |  |  |  | local $HTTP::Headers::TRANSLATE_UNDERSCORE;
400 |  |  |  |  | $response->push_header(@h);
401 |  |  |  |  | }
402 |  |  |  |  |
403 |  |  |  |  | # keep-alive support
404 | 3 | 6µs |  |  | unless ($drop_connection) {
405 | 6 | 54µs |  |  | if (my $conn_cache = $self->{ua}{conn_cache}) {
406 |  |  |  |  | my %connection = map { (lc($_) => 1) } # spent 107µs making 3 calls to HTTP::Message::__ANON__[HTTP/Message.pm:622], avg 36µs/call
407 |  |  |  |  | split(/\s*,\s*/, ($response->header("Connection") || ""));
408 |  |  |  |  | if (($peer_http_version eq "1.1" && !$connection{close}) || # spent 74µs making 2 calls to LWP::ConnCache::deposit, avg 37µs/call # spent 9µs making 2 calls to LWP::Protocol::http::socket_type, avg 5µs/call
409 |  |  |  |  | $connection{"keep-alive"})
410 |  |  |  |  | {
411 |  |  |  |  | $conn_cache->deposit($self->socket_type, "$host:$port", $socket);
412 |  |  |  |  | }
413 |  |  |  |  | }
414 |  |  |  |  | }
415 |  |  |  |  |
416 |  |  |  |  | $response;
417 |  |  |  |  | }
418 |  |  |  |  |
419 |  |  |  |  |
420 |  |  |  |  | #-----------------------------------------------------------
421 |  |  |  |  | package LWP::Protocol::http::SocketMethods;
422 |  |  |  |  |
423 |  |  |  |  | # spent 174ms (141µs+174) within LWP::Protocol::http::SocketMethods::sysread which was called 7 times, avg 24.9ms/call: # 5 times (123µs+174ms) by Net::HTTP::Methods::my_readline at line 256 of Net/HTTP/Methods.pm, avg 34.9ms/call # 2 times (17µs+48µs) by Net::HTTP::Methods::my_read at line 236 of Net/HTTP/Methods.pm, avg 33µs/call sub sysread {
424 | 21 | 196µs |  |  | my $self = shift;
425 | 7 | 19µs |  |  | if (my $timeout = ${*$self}{io_socket_timeout}) {
426 |  |  |  |  | die "read timeout" unless $self->can_read($timeout); # spent 174ms making 7 calls to LWP::Protocol::http::SocketMethods::can_read, avg 24.9ms/call
427 |  |  |  |  | }
428 |  |  |  |  | else {
429 |  |  |  |  | # since we have made the socket non-blocking we
430 |  |  |  |  | # use select to wait for some data to arrive
431 |  |  |  |  | $self->can_read(undef) || die "Assert";
432 |  |  |  |  | }
433 |  |  |  |  | sysread($self, $_[0], $_[1], $_[2] || 0); # spent 90µs making 7 calls to LWP::Protocol::http::SocketMethods::CORE:sysread, avg 13µs/call
434 |  |  |  |  | }
435 |  |  |  |  |
436 |  |  |  |  | # spent 174ms (215µs+174) within LWP::Protocol::http::SocketMethods::can_read which was called 8 times, avg 21.8ms/call: # 7 times (204µs+174ms) by LWP::Protocol::http::SocketMethods::sysread at line 426, avg 24.9ms/call # once (11µs+8µs) by LWP::Protocol::http::_new_socket at line 22 sub can_read {
437 | 32 | 32µs |  |  | my($self, $timeout) = @_;
438 |  |  |  |  | my $fbits = '';
439 |  |  |  |  | vec($fbits, fileno($self), 1) = 1;
440 | 40 | 174ms |  |  | SELECT:
441 |  |  |  |  | {
442 |  |  |  |  | my $before;
443 |  |  |  |  | $before = time if $timeout;
444 |  |  |  |  | my $nfound = select($fbits, undef, undef, $timeout); # spent 174ms making 8 calls to LWP::Protocol::http::SocketMethods::CORE:sselect, avg 21.8ms/call
445 |  |  |  |  | if ($nfound < 0) {
446 |  |  |  |  | if ($!{EINTR} || $!{EAGAIN}) {
447 |  |  |  |  | # don't really think EAGAIN can happen here
448 |  |  |  |  | if ($timeout) {
449 |  |  |  |  | $timeout -= time - $before;
450 |  |  |  |  | $timeout = 0 if $timeout < 0;
451 |  |  |  |  | }
452 |  |  |  |  | redo SELECT;
453 |  |  |  |  | }
454 |  |  |  |  | die "select failed: $!";
455 |  |  |  |  | }
456 |  |  |  |  | return $nfound > 0;
457 |  |  |  |  | }
458 |  |  |  |  | }
459 |  |  |  |  |
460 |  |  |  |  | sub ping {
461 |  |  |  |  | my $self = shift;
462 |  |  |  |  | !$self->can_read(0);
463 |  |  |  |  | }
464 |  |  |  |  |
465 |  |  |  |  | # spent 14µs within LWP::Protocol::http::SocketMethods::increment_response_count which was called 3 times, avg 5µs/call: # 3 times (14µs+0s) by LWP::Protocol::http::request at line 377, avg 5µs/call sub increment_response_count {
466 | 6 | 25µs |  |  | my $self = shift;
467 |  |  |  |  | return ++${*$self}{'myhttp_response_count'};
468 |  |  |  |  | }
469 |  |  |  |  |
470 |  |  |  |  | #-----------------------------------------------------------
471 |  |  |  |  | package LWP::Protocol::http::Socket;
472 | 3 | 56µs | 2 | 78µs | # spent 45µs (12+33) within LWP::Protocol::http::Socket::BEGIN@472 which was called # once (12µs+33µs) by LWP::Protocol::implementor at line 472 use vars qw(@ISA); # spent 45µs making 1 call to LWP::Protocol::http::Socket::BEGIN@472 # spent 33µs making 1 call to vars::import
473 | 1 | 18µs |  |  | @ISA = qw(LWP::Protocol::http::SocketMethods Net::HTTP);
474 |  |  |  |  |
475 | 1 | 10µs |  |  | 1;
|  |  |  |  | # spent 30µs within LWP::Protocol::http::CORE:match which was called 15 times, avg 2µs/call: # 3 times (17µs+0s) by LWP::Protocol::http::request at line 129 of LWP/Protocol/http.pm, avg 6µs/call # 3 times (4µs+0s) by LWP::Protocol::http::request at line 295 of LWP/Protocol/http.pm, avg 1µs/call # 3 times (4µs+0s) by LWP::Protocol::http::request at line 327 of LWP/Protocol/http.pm, avg 1µs/call # 3 times (4µs+0s) by LWP::Protocol::http::request at line 151 of LWP/Protocol/http.pm, avg 1µs/call # 3 times (900ns+0s) by LWP::Protocol::http::request at line 203 of LWP/Protocol/http.pm, avg 300ns/call sub LWP::Protocol::http::CORE:match; # xsub
|  |  |  |  | # spent 27µs within LWP::Protocol::http::CORE:sselect which was called 3 times, avg 9µs/call: # 3 times (27µs+0s) by LWP::Protocol::http::request at line 275 of LWP/Protocol/http.pm, avg 9µs/call sub LWP::Protocol::http::CORE:sselect; # xsub
|  |  |  |  | # spent 9µs within LWP::Protocol::http::CORE:subst which was called 21 times, avg 448ns/call: # 9 times (3µs+0s) by LWP::Protocol::http::__ANON__[/usr/local/lib/perl5/site_perl/5.10.1/LWP/Protocol/http.pm:167] at line 164 of LWP/Protocol/http.pm, avg 344ns/call # 9 times (3µs+0s) by LWP::Protocol::http::__ANON__[/usr/local/lib/perl5/site_perl/5.10.1/LWP/Protocol/http.pm:167] at line 165 of LWP/Protocol/http.pm, avg 311ns/call # 3 times (3µs+0s) by LWP::Protocol::http::_fixup_header at line 88 of LWP/Protocol/http.pm, avg 1µs/call sub LWP::Protocol::http::CORE:subst; # xsub
|  |  |  |  | # spent 174ms within LWP::Protocol::http::SocketMethods::CORE:sselect which was called 8 times, avg 21.8ms/call: # 8 times (174ms+0s) by LWP::Protocol::http::SocketMethods::can_read at line 444 of LWP/Protocol/http.pm, avg 21.8ms/call sub LWP::Protocol::http::SocketMethods::CORE:sselect; # xsub
|  |  |  |  | # spent 90µs within LWP::Protocol::http::SocketMethods::CORE:sysread which was called 7 times, avg 13µs/call: # 7 times (90µs+0s) by LWP::Protocol::http::SocketMethods::sysread at line 433 of LWP/Protocol/http.pm, avg 13µs/call sub LWP::Protocol::http::SocketMethods::CORE:sysread; # xsub