[,hdZddlZddlZddlZddlZddlmZmZddlm Z ddl m Z ddl m Z ddl mZdd lmZmZdd lmZdZd ZGd d ZGddZGddeZy)zB Provides all the main functional classes for analyzing HAR files N)ListOptional)Counter)cached_property)parser)PageNotFoundError)RequestResponse) MimicDictcBtjfd}|S)zDWrapper function for converting dicts of entries to HarEnrty Objectsct|}t|dtrt|d|d<t |i|S)Nr)list isinstancedictHarEntrytuple)argskwargs changed_argsfuncs L/var/www/html/trade_iq/venv/lib/python3.12/site-packages/haralyzer/assets.pyinnerzconvert_to_entry..innersCDz l1ot ,&|A7LOU<(3F33) functoolswraps)rrs` rconvert_to_entryrs'__T44 LrceZdZdZd!defdZedeegddfdZ edeegfd Z ee d"d d d ed edede de f dZ ee d"d d dede de fdZee d"d d dede de fdZee d"d d dede de fdZee d"d d dede de fdZeded defdZededfdZedefdZedefdZedefdZedefd Zy)# HarParserzj A Basic HAR parser that also adds helpful stuff for analyzing the performance of a web page. Nhar_datacR|rt|ts td|d|_y)z :param har_data: a ``dict`` representing the JSON of a HAR file (i.e. - you need to load the HAR data into a string using json.loads or requests.json() if you are pulling the data via HTTP. zYA dict() representation of a HAR file is required to instantiate this class. Please RTFM.logN)rr ValueErrorr )selfr s r__init__zHarParser.__init__.s/ z(D9; ! rfilereturnct|dd5}ttj|cdddS#1swYyxYw)z Function create a HarParser from a file path :param file: Path to har file or bytes of har file :type file: [str, bytes] :return: HarParser Object :rtype HarParser rzutf-8)r&modeencodingN)openrjsonload)r&infiles r from_filezHarParser.from_file;s8t# 8 0FTYYv./ 0 0 0s 7Adatac>ttj|S)z Function to load string or bytes as a HarParser :param data: Input string or bytes :type data: [str, bytes] :return: HarParser Object :rtype HarParser )rr-loads)r1s r from_stringzHarParser.from_stringHsD)**rentryr header_typeheadervalueregexc|dvr tdt||jD]d}|dj|jk(s(|d.|r+t j ||dtj ry||dk(sdyy)a Function to match headers. Since the output of headers might use different case, like: 'content-type' vs 'Content-Type' This function is case-insensitive :param entry: Entry to analyze :type entry: HarEntry :param header_type: Header type. Valid values: 'request', or 'response' :type header_type: str :param header: The header to search for :type header: str :param value: The value to search for :type value: str :param regex: Whether to use regex or exact match :type regex: bool :returns: Whether a match was found :rtype: bool )requestresponsez?Invalid header_type, should be either: * 'request' *'response'namer8flagsTF)r#getattrheaderslowerresearch IGNORECASE)r5r6r7r8r9hs r match_headerszHarParser.match_headersTs: 5 5T   ,44 Ay FLLN2qz7MRYYuaj NAgJ&  r content_typec|jj}|r'tj||tjry||k(ryy)a Matches the content type of a request using the mimeType metadata. :param entry: Entry to analyze :type entry: HarEntry :param content_type: Regex to use for finding content type :type content_type: str :param regex: Whether to use regex or exact match. :type regex: bool :return: Mime type matches :rtype: bool r>TF)r<mimeTyperCrDrE)r5rHr9 mime_types rmatch_content_typezHarParser.match_content_types:"NN++ RYY|YbmmL 9 $r request_typec|rN)rCrDr;methodrE)r5rMr9s rmatch_request_typezHarParser.match_request_typesI$  , (<(N)r< httpVersionrCrDrE)r5rQr9response_versions rmatch_http_versionzHarParser.match_http_versionsF$!>>55  ,(8 N  <//r status_codec|r5tj|t|jjduSt|jj|k(S)a Helper function that returns entries with a status code matching then given `status_code` argument. NOTE: This is doing a STRING comparison NOT NUMERICAL :param entry: Entry to analyze :type entry: HarEntry :param status_code: Status code to search for :type status_code: str :param regex: Whether to use a regex or string match :type regex: bool :return: Status code matches :rtype: bool N)rCrDstrr<status)r5rVr9s rmatch_status_codezHarParser.match_status_codesF( 99[#enn.C.C*DETQ Q5>>(()[88r asset_listc*i}|D]}|j}t|j}||vr||j|n|g||<t d|D]:}|t j dz}||vr||j|5|g||<<|S)a Returns a `dict` of the timeline for the requested assets. The key is a datetime object (down to the millisecond) of ANY time where at least one of the requested assets was loaded. The value is a `list` of ALL assets that were loading at that time. :param asset_list: The assets to create a timeline for. :type asset_list: List[HarEntry] :return: Milliseconds and assets that were loaded :rtype: dict r) milliseconds) startTimeinttimeappendrangedatetime timedelta)r[resultsassettime_key load_time_s rcreate_asset_timelinezHarParser.create_asset_timelines 0EHEJJI7"!((/%*G!1i( 0#h&8&8a&HHw&H%,,U3).GH%  0 0$rHarPagecg}td|jdDr|jtd||jj dgD]#}t|d|}|j|%|S)z This is a list of HarPage objects, each of which represents a page from the HAR file. :return: HarPages in the file :rtype: List[HarPage] c3$K|]}d|v yw)pagerefN).0r5s r z"HarParser.pages..sL%y%Lsentriesunknown) har_parserpagesid)anyr rarkget)r$ruhar_pagepages rruzHarParser.pagessv L4==3KL L LLt< = ))'26 H8D>d;D LL   rc |jdS)zc Browser of Har File :return: Browser of the Har File :rtype: str browserr r$s rr|zHarParser.browser}}Y''rc |jdS)zW HAR Version :return: Version of HAR used :rtype: str versionr}r~s rrzHarParser.version$rrc |jdS)z Creator of Har File. Usually the same as the browser but not always :return: Program that created the HarFile :rtype: str creatorr}r~s rrzHarParser.creator.rrc||jDcgc]}|jdk7s|}}|djScc}w)zo Hostname of first page :return: Hostname of the first known page :rtype: str rsr)rupage_idhostname)r$p valid_pagess rrzHarParser.hostname8s<#'**GQ Y0FqG G1~&&&Hs99N)T)__name__ __module__ __qualname____doc__rr% staticmethodrXbytesr0r4rboolrGrLrPrUrZrrjpropertyrur|rrrrrorrrr(sW ( ( 0e 0 0 0 +3, + +TX''(+'58'AD'MQ' ''R<@),59 0<@44),4594 44.<@00),0590 000;?99(+9489 99,$z*:tBtI&((((((((('#''rrceZdZdZ dDdedddefdZdZd Zd Z d ed e d fdZ d ed e fdZ d efdZd ed ee fdZ dEdedededede ded e d fdZ dFdedededed e f dZede d d e fdZede d d e fdZed efdZed eefdZed e d fd Zed ee fd!Zed e d fd"Zed e d fd#ZedGd$Zed efd%Zed e d fd&Z ed e d fd'Z!ed e d fd(Z"ed e d fd)Z#ed e d fd*Z$ed e d fd+Z%ed e d fd,Z&ed e fd-Z'ed e fd.Z(ed e fd/Z)ed e fd0Z*ed e fd1Z+ed e fd2Z,ed e fd3Z-ed e fd4Z.ed e fd5Z/ed e fd6Z0ed e fd7Z1ed e fd8Z2ed e fd9Z3ed e fd:Z4ed e fd;Z5ed e fd<Z6ed e fd=Z7ed e fd>Z8ed e fd?Z9ed e fd@Z:ed e fdAZ;ed e fdBZ>rrrc~d}|D]5}|jjdkDs||jjz }7|S)z Returns the total size of a collection of entries. :param entries: ``list`` of entries to calculate the total size of. :return: Total size of entries :rtype: int r)r<bodySizerrsizer5s rrzHarPage.get_total_sizeAsE 0E~~&&*/// 0 rcd}|D];}|jjddkDs ||jjdz }=|S)a3 Returns the total size of a collection of entries - transferred. NOTE: use with har file generated with chrome-har-capturer :param entries: ``list`` of entries to calculate the total size of. :return: Total size of entries that was transferred :rtype: int r _transferSize)r< raw_entryrs rrzHarPage.get_total_size_transPsQ BE~~''81<00AA B rcr|jdjjD]}|ddk(s |dcSy)zN :return: Hostname of the initial request :rtype: str rr=Hostr8N)rrr;rA)r$r7s rrzHarPage.hostnamecs= ll1o--55 'Ff~'g& 'rcd|jdjvrHd|jdjjvr#|jdjjSy)zu The absolute URL of the initial request. :return: URL of first request :rtype: str r;rrN)rrrr;rr~s rrz HarPage.urlmsS a22 2a00:::<<?**.. .rc>g}|jjdD]^}d|vr+|jdk(s|jt |2|d|jk(sE|jt |`t d|Drt |dS|S)z[ :return: All entries that make up the page :rtype: List[HarEntry] rrrnrsc34K|]}|jywrr^)rpxs rrqz"HarPage.entries..s1qq{{1sc|jSrrr5s rz!HarPage.entries..s %//r)key)rr rrarallsorted)r$ page_entriesr5s rrrzHarPage.entries|s  [[)))4 5E%<<9, ''8y!T\\1##HUO4  5 1L1 1,,IJ Jrc|jdk(ryd}|jD]`}|jjdk(r6|jj D]\}}|dk7s |dkDs||z }|S||j z }b|S)z[ :return: Time to first byte of the page request in ms :rtype: int rsNrreceive)rrrr<rYtimingsitemsr`)r$ttfbr5kvs rtime_to_first_bytezHarPage.time_to_first_bytes <<9 $\\ E~~$$+!MM//1&DAqI~q5 AID&  EJJ D  rc&|jdS)z Returns a list of GET requests, each of which is a HarEntry object :return: All GET requests :rtype: List[HarEntry] rxrMrr~s r get_requestszHarPage.get_requestss"""66rc&|jdS)z Returns a list of POST requests, each of which is an HarEntry object :return: All POST requests :rtype: List[HarEntry] postrrr~s r post_requestszHarPage.post_requestss"""77rcv|jD]*}d|jjcxkr dkr#|cS|cSy)z Returns the first entry object that does not have a redirect status, indicating that it is the actual page we care about (after redirects). :return: First entry of the page :rtype: HarEntry i,iN)rrr<rY)r$r5s rrzHarPage.actual_pages=\\ E%..//636 7  rct|jDcgc]}|jjc}}|j Dcic]\}}|dkDs ||c}}Scc}wcc}}w)z Returns a dict of urls and its number of repetitions that are sent more than once :return: URLs and the amount of times they were duplicated :rtype: dict r)rrrr;rr)r$r5 counted_urlsrrs rduplicate_url_requestzHarPage.duplicate_url_requestsXt||Le 1 1LM !-!3!3!5?AQ1?? M?sA" A'A'c$|jdS)zv All image files for a page :return: Image entries for a page :rtype: List[HarEntry] rrr~s r image_fileszHarPage.image_files$$W--rc$|jdS)zr All CSS files for a page :return: CSS entries for a page :rtype: List[HarEntry] rrr~s r css_fileszHarPage.css_filess$$U++rc$|jdS)zt All text files for a page :return: Text entries for a page :rtype: List[HarEntry] rrr~s r text_fileszHarPage.text_files$$V,,rc$|jdS)zp All JS files for a page :return: JS entries for a page :rtype: List[HarEntry] rrr~s rjs_fileszHarPage.js_filess$$T**rc$|jdS)zv All audio files for a page :return: Audio entries for a page :rtype: List[HarEntry] rrr~s r audio_fileszHarPage.audio_filesrrc$|jdS)zv All video files for a page :return: Video entries for a page :rtype: List[HarEntry] rrr~s r video_fileszHarPage.video_filesrrc$|jdS)zt All HTML files for a page :return: HTML entries for a page :rtype: List[HarEntry] rrr~s r html_fileszHarPage.html_filesrrc$|jdS)zY Size of the page :return: Size of the page :rtype: int rzrr~s r page_sizezHarPage.page_size##F++rc$|jdS)zy Size of image files from the page :return: Size of image files on the page :rtype: int rrr~s r image_sizezHarPage.image_size$##G,,rc$|jdS)zu Size of CSS files from the page :return: Size of CSS files on the page :rtype: int rrr~s rcss_sizezHarPage.css_size.##E**rc$|jdS)zw Size of text files from the page :return: Size of text files on the page :rtype: int rrr~s r text_sizezHarPage.text_size8r rc$|jdS)zs Size of JS files from the page :return: Size of JS files on the page :rtype: int rrr~s rjs_sizezHarPage.js_sizeB##D))rc$|jdS)zy Size of audio files from the page :return: Size of audio files on the page :rtype: int rrr~s r audio_sizezHarPage.audio_sizeLr rc$|jdS)zy Size of video files from the page :return: Size of video files on the page :rtype: int rrr~s r video_sizezHarPage.video_sizeVr rc$|jdS)zm Page transfer size :return: Size of transfer data for the page :rtype: int rzrr~s rpage_size_transzHarPage.page_size_trans`))&11rc$|jdS)zl Image transfer size :return: Size of transfer data for images :rtype: int rrr~s rimage_size_transzHarPage.image_size_transj))'22rc$|jdS)zg CSS transfer size :return: Size of transfer data for CSS :rtype: int rrr~s rcss_size_transzHarPage.css_size_transts))%00rc$|jdS)zi Text transfer size :return: Size of transfer data for text :rtype: int rrr~s rtext_size_transzHarPage.text_size_trans~rrc$|jdS)ze JS transfer size :return: Size of transfer data for JS :rtype: int rrr~s r js_size_transzHarPage.js_size_transs))$//rc$|jdS)zk Audio transfer size :return: Size of transfer data for audio :rtype: int rrr~s raudio_size_transzHarPage.audio_size_transr rc$|jdS)zl Video transfer size :return: Size of transfer data for images :rtype: int rrr~s rvideo_size_transzHarPage.video_size_transr rc$|jdS)zg Initial load time :return: Initial load time of the page :rtype: int rrr~s rinitial_load_timezHarPage.initial_load_time##I..rc$|jdS)zc Content load time :return: Load time for all content :rtype: int rr,r~s rcontent_load_timezHarPage.content_load_timer.rc$|jdS)zd Load time of the page :return: Load time for the page :rtype: int rzr,r~s rpage_load_timezHarPage.page_load_timer rc$|jdS)zf Image load time :return: Load time for images on a page :rtype: int rr,r~s rimage_load_timezHarPage.image_load_timer rc$|jdS)za CSS load time :return: Load time for CSS on a page :rtype: int rr,r~s r css_load_timezHarPage.css_load_timerrc$|jdS)z_ JS load time :return: Load time for JS on a page :rtype: int rr,r~s r js_load_timezHarPage.js_load_timerrc$|jdS)ze Audio load time :return: Load time for audio on a page :rtype: int rr,r~s raudio_load_timezHarPage.audio_load_timer rc$|jdS)ze Video load time :return: Load time for video on a page :rtype: int rr,r~s rvideo_load_timezHarPage.video_load_timer rc$|jdS)zc HTML load time :return: Load time for HTML on a page :rtype: int rr,r~s rhtml_load_timezHarPage.html_load_timer r)NN)NNNNNT)NNNT)r'r)>rrrrrXrr%rrrrrr_rrrrrrrrrrrrrrrrrrrrrrrrrrrr r rrrrrrrr"r$r&r(r*r-r0r2r4r6r8r:r<r>rorrrkrkDs NR00(30FJ0d6"N3N4 3CN 1 1 1 +# +M#M(3-M:!  !BBB B  B  BB j BL! ! /?/?/? /?  /? /?b Z 0 S  d:&63$'#'' Xc]  j)"HSM*7d:.778tJ/88  @t@@.T*-..,4 +,,-D,--+$z*++.T*-...T*-..-D,--,3,,-C--+#++,3,,***-C---C--2223#331112220s003#333#33/3///3//,,,---+s++*c**------,,,rrkcleZdZdZdeffd ZdZdZede fdZ ede fdZ ede ejfd Zedefd Zedefd Zedefd Zedefd ZedefdZedefdZedefdZedefdZedefdZedefdZxZS)rz: An object that represent one entry in a HAR Page r5c0||_t| yr)rsuperr%)r$r5 __class__s rr%zHarEntry.__init__s rc d|jSNz HarEntry for rr~s r__str__zHarEntry.__str__ txxj))rc d|jSrDrEr~s rrzHarEntry.__repr__ rGrr'c4t|jdS)zG :return: Request of the entry :rtype: Request r;r)r rr~s rr;zHarEntry.requests T^^I677rcJt|j|jdS)zI :return: Response of the entry :rtype: Response r<)rr5)r rrr~s rr<zHarEntry.responses DHHDNN:,FGGrc tj|jjddS#tjj $rYywxYw)zw Start time and date :return: Start time of entry :rtype: Optional[datetime.datetime] rrN)rparserrx_parser ParserErrorr~s rr^zHarEntry.startTime sD << 2 23Db IJ J~~))  s.1AAc |jdS)z= :return: Cached objects :rtype: str cacherr~s rrPzHarEntry.cache.s ~~g&&rc:|jjdgS)zL :return: Request and Response Cookies :rtype: list cookiesrrxr~s rrSzHarEntry.cookies6s ~~!!)R00rc |jdS)zA :return: Page for the entry :rtype: str rnrQr~s rrnzHarEntry.pageref> ~~i((rc2t|jdS)zJ :return: Port connection was made to :rtype: int connection)r_rr~s rportz HarEntry.portFs 4>>,/00rc@|jjdddk(S)zE :return: Connection was secure :rtype: bool _securityStatersecurerTr~s rr\zHarEntry.secureNs! ~~!!"2B78CCrc |jdS)zG :return: IP Address of the server :rtype: str serverIPAddressrQr~s r serverAddresszHarEntry.serverAddressVs ~~/00rc&|jddS)z? :return: HTTP Status Code :rtype: int r<rYrQr~s rrYzHarEntry.status^s ~~j)(33rc |jdS)zK :return: Time taken to complete entry :rtype: int r`rQr~s rr`z HarEntry.timefs ~~f%%rc |jdS)zG :return: Timing of the page load :rtype: dict rrQr~s rrzHarEntry.timingsnrVrc&|jddS)z2 :return: URL of Entry :rtype: strr;rrQr~s rrz HarEntry.urlvs ~~i(//r)rrrrrr%rFrrr r;r r<rrcr^rXrPrrSrnr_rYrr\r_rYr`rr __classcell__)rBs@rrrsd**888H(HH 8H$5$56  's''111)))1c11DDD1s11444&c&&)))0S00rr)rrrcr-rCtypingrr collectionsrrdateutilrerrorsr httpr r mixinsr DECIMAL_PRECISIONrrrkrrorrrlsb !+%# Y'Y'xz ,z ,zz0yz0r