GETURI Release Notes

v1.00b  - Original

v1.01b  - Changed size of data parameter from 256 to 2048 characters.

v1.02b  - Added option to specify *STMF for data parameter and use

           a stream file to send the request data parameters.

v1.03b  - Added parameters to specify userid and password for

           basic authorization.

v1.04b  - Changed command to not show password in job log.  

          Internal processing updates.

v1.05b  - HOST parameter wasn't being used.  Fixed.

          Authentication was adding an extra line feed causing errors

           when making requests to some systems.  Fixed.

v1.06b  - Added ability to include Cookie: header.  See parameter help

           for location of RFC and formatting of this data.

v1.07b  - Added SSL Timeout parameter to specify a timeout value for 

           the SSL Handshake operation

v1.08b  - Added DEBUG paramter.  When specified as *YES, the HTTP 

           header used will be written to the stream file

           /tmp/geturidebug.txt.  

v1.09b  - Changed the length of the cookie parameter from 1024 to

           4096, the max specified in the RFC.

v1.10b  - When doing a POST and specifying the URI data in a stream

           file, size was limited to 32k.  Changed this to be 

           unlimited.  GET is still limited to 32k.

v1.11   - Removed beta status.  Added REFERER parameter that allows

           a user to specify a Referer that will be placed in the 

           HTTP header request.

v1.12   - Added timeout functionality.  There is now a TIMEOUT 

           parameter on the GETURI command.  The default is 30 seconds.  

          A special thanks to Paul Nicolay for assistance with 

           this portion of the utility.

v1.13   - Fixed Accept parameter.  GETURI was always using text/html

           and ignoring this parameter.

v2.00b  - Beta version.  Please be sure to test this version if you

           were using a previous version in production for 

           compatibility with your applications.

          Added ability to simulate an HTML form file upload.  

           Specify UPFILE(*YES) and you will be prompted with fields

           to fill in the qualified file name located in the IFS to

           upload, the form file field name, and the file content

           type.

          Fixed debug file so that it won't be garbage if emailed or

           FTPed, etc.

          Added CONNECTION parameter.  This is used to specify a

           Connection: value such as Keep-Alive in the header.

          Added CLOSE parameter.  This parameter allows you to specify

           if the connection/socket should be closed after GETURI 

           completes.  

v2.01b  - Added ability to specify content-type.

          Added ability to specify a SOAPAction header.

          Removed extra CRLFs from POST actions.

          Added a warning message that if the socket read times out

           after 1 or more successful reads.  The command will still

           complete normally, but a warning message will be issued.

v2.02b  - Added user defined header/data parmeters.  With these you can enter

           up to 20 user defined HTTP headers and associated data parameters.

          Removed SOAPAction parameter.  If you were using this previously 

           you can use the new user defined header section to include this

           parameter.

          Minimum release level is now V4R5.

v3.00b  - Added *HEAD as an option for request method.

          Added API interface.  See documentation for more information on this at:

           http://www.bvstools.com/docs/geturi/

v3.10b  - Added Certificate Password parameter.  

          Added error checking so errors don't result in a hard halt from the

           GETURI command.

v3.20b  - Added SSL Application ID parameter.  This parameter is to assign 

           the GETURI application a unique ID that can be used when assigning

           trusted certificates to certain applications.

v3.21b  - Bug fix on using SSL Application ID parameter.  Was allocating storage

           incorrectly.  Fixed to allocate a default of 4096 bytes using malloc().

v3.22b  - Added EBCDIC to ASCII translation table parameter (EATABLE) and

           ASCII to EBCDIC translation table parameter (AETABLE).

v3.23b  - Increased size of storage allocated for application certificate from

           4k to 32k.

v3.24   - Changed program to use the defaults QTCPASC for EATABLE and 

           QEBCDIC for the AETABLE values if left blank when using the API 

           interface.

          Added parameters LOCIP and LOCPORT which allow you to specify a local 

           IP address and Port to bind the request to.

v3.25   - Updated application to set defaults for GI_CStore to *SYSTEM and

           GI_Close to *YES if left blank.

v3.30  - **NOTE**

         Updated registration to use Serial Number and Model number.

         Removed display to screen only limit from unregistered version.  Instead, 

          temporary keys will be issued to allow unlimited testing for a period of time.

         -- Current Users --

         Email me a note with your serial number(s) and model number(s) before you

          install this version so I can get you a new key.  

         -- New Users --

         Email me and I will get you a temporary key.  This temporary key will allow you

          to use GETURI with all functionality for a limited period of time.  You

          need a temporary key or a permanent key to use GETURI.  

v3.31  - Fixed small problem with temporary registration key processing.

v3.32  - Fixed bug when errors exist and files aren't closed.

v3.33  - Fixed small bug when using *RETURN in the GETURIRG API

v3.34  - Added SPRHEAD parameter which can be used to supress the HTTP headers from

          the result.  This option is only valid with output type of *STMF or

          *RETURN.  If SPRHEAD(*YES) is specified and *STMF is the output type,

          the headers will be placed in a file named "xxxxx.hdr" where "xxxxx" is the

          file name specified for the output file name.  If the API is used there is

          now a 3rd parameter to the GETURIRG API call that will contain the headers

          if the Supress Headers option is used.

v3.35  - Added UPNAME parameter.  This is used when uploading a file (UPFILE(*YES)) and

          allows you to name the file that is being uploaded anything you want.  If

          left as the default of *UPSTMF the stream file used, along with the entire path,

          will be used as the filename (same as before this update).

v3.36  - Added CCSID parameter to be used for EBCDIC to ASCII and ASCII to EBCDIC

          translations.  This was added so the conversion functionality was more like

          the TCPIP servers on the iSeries.  When left as the default of *TBL, the 

          EBCDIC and ASCII tables specified will be used instead of the CCSID.

v3.37  - Fixed small bug when supressing headers and using SSL.

v3.38  - Added HTTPHEAD parameter.  When specifying *NO no HTTP headers will be sent,

          only the data.  When *USRHDR is specifyied, only the user specified headers

          will be used.  Defaults to *YES which will perform as normal.

          When specifying *NO or *USRHDR, the POST method must be used.

v3.39  - Fixed small bug where in rare cases when using API the returned data would

          be shifted over on 2nd - nth calls.

v3.40  - Fixed bug when using API interface.  The Content-length header was not

          getting sent in some cases.

v3.41  - Forced Non-Blocking sockets.

         Changed HOST parm default to *DFT which will use the domain name in the

          request as the host name.

v3.42  - Changed URI parameter length from 128 to 256.

v3.43  - Updated to handle HTTP 1.1 chunked data and content length.

v3.44  - Fixed bug when using GET method and *STMF for input.  Was putting data

          in the URL and in standard input.

v3.45  - When specifying *DFT for HOST parmater added port to the string if it wasn't

          a default port used.

v3.46  - Changed the maximum number of user headers from 20 to 50

v3.47  - Added the DEBUGF parmater in order to allow the user to name the debuf file

          whatever they want.  This value still defaults to /tmp/geturidebug.txt 

          and should not cause any conflicts with previous versions.

          The new parameter added to the API interface is GI_DebugFile.

v3.48  - Internal updates for RXS.

v3.49  - Updates that possibly closed non-GETURI sockets causing issues with

          other applications.

v3.50  - Clean up closing stream files which may have also closed other sockets

v3.51  - Updated return variables for GETURI API from 32767 bytes to 

          65535 bytes

v4.00  - Registration changes.  See installation notes.   

v4.01  - Fix to registration.  If you received new permanent keys for v4.00, please 

          email us for a new key before installing.

         Changed processing so if specifying a proxy and using basic authentication user

          id and password it would use the Proxy-Authorization header for proxy

          authentication. 

v4.02  - Bug in registration when using GETURI command.  API still worked fine, but using

          command showed unregistered message after upgrading to v4.00 or v4.01 and

          installing new keys.

v4.03  - Added new parameters for Proxy Authentication so they are separate from the Basic

          Authentication parameters.

v4.04  - (SP061212) Updated GETURI to handle requests without HTTP headers.

         (SP070102) Updated GETURI so Content-Length value is always started

          back at zero.

         Added *NONE options for HOST and CONTTYPE parameters.  When used on either of 

          these parameters, the header specified as *NONE will not be sent. 

v4.05  - Added new parms to GETURIRG API interface.  They are as follows:

          ----------------

          GetUri_Data - Parameter used to pass up to 65k of data instead of using the

           GI_Data parm or a Stream file.  To use this, the GI_Data parm must contain 

           the value of *PARM and the request method must be POST.

          GetUri_MsgCd - Message code returned from the GETURIRG API.  

           C=Completed, D=Diagnostic Messages, E=Error

          GetUri_Msg - Message text returned from the GETURIRG API.  This is the same

           message that is sent to the job log.

          ----------------

         These new parms are included in the updated version of the GETURICOPY member.

         Added error checking for blank URI.

         Fixed bug when content length was zero it wasn't using a zero, instead a blank.

         Updated application so that the HTTP headers are always returned in the

          GETURI_Head paramater, not just when headers are supressed.

v4.06  - (v4.05 SP) Updated GETURI to throw error when no server is specified

            instead of a STRING error.

         (v4.05 SP) Added option of *OFF for the DEBUG parameter which will tell

            GETURI to not send any messages during the running of the

            applications.

         (v4.05 SP) Changed SSLInitDS to a specific size of 64 bytes (per IBM)

         (v4.05 SP) Updated Base64 encoding for userid and password when using

            Basic Authentication.  Base64 routine was automatically

            adding CRLF to strings over 64bytes causing problems

            with authentication.

         Added new option to use the special value of *STMF for user header (USRHDR)

          and a path to an IFS file for the user header data.  This will import custom

          headers larger that the parameters allow to be entered.  Example:

          USRHDR((*STMF '/tmp/headtest.txt') 

v4.07  - (v4.06 SP) Fixed bug in GETURI when sending a diagnostic error it wasn't

          closing files, sockets, etc.

         (v4.06 SP) Allowed the value SOCKET to be used for the PROTO (GI_Proto)

          parameter to be used when working directly with sockets.

         (v4.06 SP) Allowed for parm value of *RETNC on the GI_OutType parm which

          stands for "Return by no Translation".  This means the data

          will be returned without being converted to EBCDIC.

         (v4.06 SP) Fixed issue when a colon was part of the URI but after the 

          server name (ie server.com/pgm:path)

         Fixed bug when uploading some files was erroring out.  Still having issues

          with some files (like zip files) when uploaded.

v4.08  - (v4.07 SP) Added ability when using the GETURIRG API to specify a very long

            URI in the GetURI_Head parameter.  This is done by specifying the

            special value of *GETURI_HEAD as the GI_URI parm and then

            specifying the long URI in the GetURI_Head parameter.

         (v4.07 SP) Updated application so when using a proxy with SSL that it would

            use proper methods for communicating with the proxy.

         (v4.07 SP)  Updated debug file processing where it would error out if code page

            1208 was used and the debug file would be blank.

         (v4.07 SP)  Fixed bug when converted data resulted in DBCS data

         (v4.07 SP)  Fixed bug when domain name started with a number.

         (v4.07 SP)  Added more debugging to conversion routines to put error number and

            text in job log should an error be encountered.

         (v4.07 SP)  Fixed bug when converting 1208 to EBCDIC.

         (v4.07 SP)  Fixed bug when sending zero bytes on a POST.

         (v4.07 SP)  Fixed bug when sending no headers, an extra CRLF was being added to

            the beginning of the data.

         (v4.07 SP)  Added SOCKET2 value for protocol to treat it more like an older

            type socket where it reads until zero bytes are returned.

         (v4.07 SP)  Added debugging for reads from sockets when DEBUG(*YES).

         (v4.07 SP)  Fixed processing for protocol type SOCKET.  It was stopping reading

            if the size of the data returned was less than the size of the

            receiver variable.  It didn't do this before and was causing

            issues with some existing processes.

         (v4.07 SP)  Added new debugging when DEBUG(*YES) is specified.  This will create

            a new file with the same name as the debug file, only with the added

            extension of log (ie /tmp/geturidebug.txt.log).  This file will

            show all the processes such as opening files and sockets, closing

            files and sockets as well as the values of the parameters passed in.

         (v4.07 SP) Update debug file.  Bytes read for stream file was incorrect, added

            logging for select().

         (v4.07 SP)  Fixed issue with debug log files getting code page of 37 instead of

            code page specified on command.

         (v4.07 SP)  Fixed bug when reading HTTP 1.1 chunked data.  The CRLF at the end of

            the data was being included in the results.  Also added some more

            info on chunked data to the geturidebug.txt.log file.

         (v4.07 SP)  Error when convering data to 1208 code page and conversion was made

            to a DBCS piece of data.  Fixed.

         (v4.07 SP)  Fixed bug when using *PARM data and length was > 32k.

         (v4.07 SP)  Fixed bug when using CCSID, data was getting converted incorrectly.  This

            bug only affected those who installed SP120426 which wasn't ever

            available to the public.

         Updated user header data field size from 128 bytes to 1024 bytes.

         SP120812 - Fixed bug when 1 byte of data would get dropped randomly.

           Bug when specifying CCSID and user headers, only first user

            header would get used.  Fixed.

           Fixed bug when data started with space.

SP140830 - Fixed issue when not using a proxy and a port was included in

            the URL.  

           Fixed issue when CLOSE was set to *NO.  It wasn't resusing sockets.

            When using this option if you're specifying HTTP 1.1 by default the

            socket will stay open.  If you're using HTTP 1.0 you need to specify

            keep-alive for the connection and even then not all servers will

            work with this.

v4.09    - Added the option to specify *MULTIPARM when using the GETURIRG API for

            the GI_Data parameter.  This value will allow you to specify data in the

            GetUri_Data parameter to be used in a multi-part POST.

           Added parameters GI_PContType and GI_PContType to the Geturi_In variable.

            these parameters allow you to specify the Content-Type value for the

            parameter data and the stream file data, respectivley, when specifying

            *MULTIPARM for the GI_Data parameter.

v4.10    - Updated background processing to use unique ID instead of timestamp for 

            temporary file.

SP141204 - Updated application so that when stream files are created 

            "other" users would get RWX authority to the files and not

            just RX.

SP150424 - Updated application to remove 100 character file name limit.

SP150609 - Updated application so the value of data area GU002DA will contain

            the SSL protocol version to use.  See

            http://www-01.ibm.com/support/knowledgecenter/ssw_ibm_i_71/apis/sslhands.htm

            for protocol versions.

SP150701 - Updated application for CCSID conversions to be more efficient and faster.

SP150903 - Compressed debugging info for reading of header information.

v5.00    - Added licensing by date (SaaS) option.

SP151004 - Updated application so when retrieving to a PF the buffer

            length was the same as the record length of the file 

            receiving data.

SP151123 - Fixed issue when reading chunked lengths for HTTP 1.1 data.

SP151201 - Found issue when trying to use GETURI and not send HTTP

            headers.  Wasn't recognizing *POST as POST method.

SP151221 - Fixed issue when CCSID of input data file was 1208.  Would

            return error Conversion error. RC(0) errno(3490).  Fixed.

v5.10    - Changed all defaults for CCSID and Code Page to 1208.

           Updated Base64 processing to use apr_base64_encode API.

v6.00    - If you are using the GETURIRG API you WILL need to recompile

            any programs to make sure the new /COPY member GETURICOPY

            is brought into your programs.

           Increased User Defined Header (GI_UsrHdr) from 30 to 

            128 bytes.

           Increased User Defined Header Data (GI_UsrHdrDta) size 

            from 1024 to 2048 bytes.

           Reduced maximum number of user headers from 50 to 20

v6.10    - Added PATCH request method.

v6.20    - Updated GI_BUser and GI_BPW from 64 to 128 bytes.

v7.00    - Added the ability to turn off SSL Strict Validation.  This is done

            by changing the value of data area GUSSL01DA to *NO.  Any other 

            value in this data area, or if the data area is deleted,

            will result in SSL Strict Validation.

           Added new feature that in debug and when you specify SSL(*YES)

            the SSL certificate used by the host you are connecting to will

            be saved in the IFS as /tmp/<debugfilename>.cer.

v7.01    - Updated to grab content length of data stream file using API.

           Updated trace file so loading content length was just a couple lines.

           Added more info to trace file such as if it ends abnormally the 

            total bytes sent vs the total bytes of the file.

v7.10    - Added data area GU003DA that holds the buffer size to use for

            reading and writing to and from stream files and sockets.

v8.00    - Fixed issue when using GETURIRG API where GI_CCSID wasn't defaulting

            to 1208.

           Updated to min OS version of V7R1.

v8.10    - Updated so when EWOULDBLOCK error (errno 3406) was encountered during

            HTTP 1.1/SSL connections we would wait until socket was ready.

v8.20    - Updated so when reading non-chunked data and content-length is zero 

            exit immediately.

v8.21    - Updated process for blocking to reset error count for each successful

            read.

v8.30    - Fixed small bug when reading chunked data and system would report a not

            ready error.

v8.31    - Fixed issue when using HTTP 1.1 and the data is NOT chunked and the size

            was greater than the buffer.

v10.00   - Added option to use GSKit for SSL communications.  This is done by setting

            the SSLMODE parameter to *GSKIT for the command, or setting GI_SSLMode to 

            *GSKIT for the API.  The default for this parameter is *DFT but in the 

            future it may change to *GSKIT as IBM seems to be moving away from 

            supporting the "legacy" SSL APIs.

           Added SNI support.  GETURI will by default use the host name as the SNI 

            parameter on SSL connections.  This can be overridden using the SNI 

            parameter on the command or the GI_SNI field in the API.  This field is 

            only valid with using *GSKIT for SSL.

v10.01   - Added data area GUSSL02DA that can be used to tell the system which SSL 

            APIs to use.  The value of *GSKIT will use the GSKit APIs and anything else

            will use the standard IBM SSL APIs.  This value can also be overridden on the

            GETURI command by specifying *IBM for the IBM SSL APIs, or *GSKIT for the

            GSKit SSL APIs.

v10.02   - Added code so that if GI_SSLMode isn't passed in it will default to *DFT.

           Changed default of data area GUSSL02DA from *DFT to *GSKIT so the GSKit will

            be used by default for SSL connections.

SP191004 - Fixed bug when reading chunked data and the 2nd to last 

            byte read was part of the ending CRLF of the chunked data.

           Added more debugging/verification to chunked data reading

            to log file.

SP200225 - Fixed issue when sending requests without a path on the URI

            and sending query string data.

SP200505 - When using option *STMF data will also be returned in the

            GetUri_Out parameter on the call to GETURIRG.

SP200506 - Added code to make sure PF is closed if *FILE output type

            is used.  Also added logging to the debug file for opening

            and closing the PF.

v10.10   - Added F.GETURI service program that contains ILE function used to

            call GETURI.

SP200827 - Added check for GSK_WOULD_BLOCK error to reading chunk length.

           Added more debugging messages so operations are more clear

            as to when errors happen.

v10.11   - Updated to work with files > 2GB.

           Updated DEBUG paramter to include the option *ALL.  This option  

            will function as *YES did in previous versions displaying 

            verbose debugging.  The value *YES will now skip most read, write

            and stat() function calls to reduce the size of the debug file and

            make it easier to read.

SP200911 - Changed HTTP headers Content-type and Content-length to

            Content-Type and Content-Length because apparently one server

            is looking for headers as case sensitive.  *tsk tsk*

SP200928-  Updated to accept Content-Type header values using HTTP 1.1

            larger than 2GB (updated field size to 64 bit int).

v11.00   - Change of parmeter sizes and types to Varying.  This now allows returning

             up to 1MB of data into your application.  If you are using the GETURIRG

             API this will require recompilation (at the very least) of your 

             those applications.

           It is STRONGLY encouraged that all new development is done using the ILE 

            functions included in the F.GETURI service program as well as converting

            existing applications to use the same.

           Removed EBCDIC to ASCII translation using tables and QDXLATE

           GI_URI increased to 65535 bytes.

           GI_UsrHdr increased to 2048 bytes.

           GI_UsrHdrDta increased to 65535 bytes.

           GI_Data increased to 65535 bytes.

           Changed default of PROTOV from 1.0 to 1.1.

           Allowed any method on command.  (Already allowed in API and ILE functions).

           Change display of data when using * as return type on GETURI command to 

            use a stream file instead of a PF.

           Changed PORT parameter default from 80 to *DFT which will automatically use

            port 80 if SSL is set to *NO or 443 if SSL is set to *YES.

           Removed proxy support.  This will not be added back in unless for some reason

            proxy technologies are updated and used as normal vs NAT.

           Any port specified on the URI will be igored.

           Added more debug details to trace files.

           Added #geturi_getHeader() function to F.GETURI to allow retrieval of HTTP header 

            data.

           Added #geturi_getResponseCode() to F.GETURI to allow retrieval of  HTTP 

            response code (and optionally the response text).

           Removed use of data area GU003DA for stream file read buffer size.  Defaults

            to the size of the buffer in the application now.

           Removed COOKIE paramter.  Use User Defined Headers for this if required.

           Added source PF QRPGLESRC to GETURI library which includes a small sample program

            that uses the ILE functions included in the F.GETURI service program.

           SP210120 - Updated #geturi_resetValues() to initialize all variables

            not just the GetUri_In data structure.

           SP210713 - Updated Content-Type to be set with the content type specified

            when upload file (gi_upfile) is *YES.

           Increased size of Upload File Content Type (gi_upcont) from 64 to  

            128.

           SP211119 - Changed METHOD on GETURI command to 10 characters and added 

            *DELETE as an option.

           SP211121 - Added option *ALL to Suppress Headers (SPHREAD) so that when

            your output is a stream file the .hdr file is not created.

v11.10  - Added option of *STMFRAW for the DATA parameter (or GI_Data) so that when

           using a stream file for the POST data it will read and write the data from

           the stream file as raw and not do any conversions. 

v12.00  - Removed the # from the beginning of all ILE function names for better

           compatibility in different code pages.

          SP220106 - Updated GET requests so data wouldn't be corrupted.

           Allow blank or *NONE for ACCEPT parameter.  If so, this header

            will not be used.

          SP220201 - Fixed issue where if debug wasn't *ON or *ALL error messages

            wouldn't be reported when using the GETURI command.  Changed

            it back to previous behavior where it will send an error 

            message unless debug is set to *OFF.  The value of *NO will 

            still send errors as well.

          SP230705 - Updated GETURI command so that user defined headers are larger.  

            The name can be up to 1024 bytes and the value for each can be

            up to 4096.        

          SP230827 - Internal change to allow requests to bvstools.com for error 

            reporting without licensing required.      
          SP230906 - Bug fix when not specifying a full URI.  

          SP230911 - Limited port to max of 65535.    

          SP240102 - Fixed bug when using geturi_getResponseCode() and not using the

            response text parameter it would corrupt part of the

            GetUri_Out data       

v13.00  - Fixed random bug when reading an SSL socket and it would block.  

          Compiled on V7R5 so min release level is now V7R3.  

          SP240510 - Updated geturi_getReponseCode() to not require a status 

            message after the code (ie, 200 vs 200 OK) to return the

            correct status code.