Make awk produce error on non-numeric












1















I have a program that sums a column in a file:



awk -v col=2 '{sum+=$col}END{print sum}' input-file


However, it has a problem: If you give it a file that doesn't have numeric data, (or if one number is missing) it will interpret it as zero.



I want it to produce an error if one of the fields cannot be parsed as a number.



Here's an example input:



bob 1
dave 2
alice 3.5
foo bar


I want it to produce an error because 'bar' is not a number, rather than ignoring the error.










share|improve this question


















  • 2





    If not a dupe, at least strongly related: Can I determine type of an awk variable?

    – Kusalananda
    2 hours ago











  • by "produce an error", do you mean stop altogether, or skip the line, and/or emit a message?

    – Jeff Schaller
    2 hours ago











  • Stop altogether and emit a message.

    – Nick ODell
    2 hours ago











  • @Kusalananda Thanks, that was really helpful.

    – Nick ODell
    2 hours ago
















1















I have a program that sums a column in a file:



awk -v col=2 '{sum+=$col}END{print sum}' input-file


However, it has a problem: If you give it a file that doesn't have numeric data, (or if one number is missing) it will interpret it as zero.



I want it to produce an error if one of the fields cannot be parsed as a number.



Here's an example input:



bob 1
dave 2
alice 3.5
foo bar


I want it to produce an error because 'bar' is not a number, rather than ignoring the error.










share|improve this question


















  • 2





    If not a dupe, at least strongly related: Can I determine type of an awk variable?

    – Kusalananda
    2 hours ago











  • by "produce an error", do you mean stop altogether, or skip the line, and/or emit a message?

    – Jeff Schaller
    2 hours ago











  • Stop altogether and emit a message.

    – Nick ODell
    2 hours ago











  • @Kusalananda Thanks, that was really helpful.

    – Nick ODell
    2 hours ago














1












1








1








I have a program that sums a column in a file:



awk -v col=2 '{sum+=$col}END{print sum}' input-file


However, it has a problem: If you give it a file that doesn't have numeric data, (or if one number is missing) it will interpret it as zero.



I want it to produce an error if one of the fields cannot be parsed as a number.



Here's an example input:



bob 1
dave 2
alice 3.5
foo bar


I want it to produce an error because 'bar' is not a number, rather than ignoring the error.










share|improve this question














I have a program that sums a column in a file:



awk -v col=2 '{sum+=$col}END{print sum}' input-file


However, it has a problem: If you give it a file that doesn't have numeric data, (or if one number is missing) it will interpret it as zero.



I want it to produce an error if one of the fields cannot be parsed as a number.



Here's an example input:



bob 1
dave 2
alice 3.5
foo bar


I want it to produce an error because 'bar' is not a number, rather than ignoring the error.







awk numeric-data






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked 2 hours ago









Nick ODellNick ODell

9942820




9942820








  • 2





    If not a dupe, at least strongly related: Can I determine type of an awk variable?

    – Kusalananda
    2 hours ago











  • by "produce an error", do you mean stop altogether, or skip the line, and/or emit a message?

    – Jeff Schaller
    2 hours ago











  • Stop altogether and emit a message.

    – Nick ODell
    2 hours ago











  • @Kusalananda Thanks, that was really helpful.

    – Nick ODell
    2 hours ago














  • 2





    If not a dupe, at least strongly related: Can I determine type of an awk variable?

    – Kusalananda
    2 hours ago











  • by "produce an error", do you mean stop altogether, or skip the line, and/or emit a message?

    – Jeff Schaller
    2 hours ago











  • Stop altogether and emit a message.

    – Nick ODell
    2 hours ago











  • @Kusalananda Thanks, that was really helpful.

    – Nick ODell
    2 hours ago








2




2





If not a dupe, at least strongly related: Can I determine type of an awk variable?

– Kusalananda
2 hours ago





If not a dupe, at least strongly related: Can I determine type of an awk variable?

– Kusalananda
2 hours ago













by "produce an error", do you mean stop altogether, or skip the line, and/or emit a message?

– Jeff Schaller
2 hours ago





by "produce an error", do you mean stop altogether, or skip the line, and/or emit a message?

– Jeff Schaller
2 hours ago













Stop altogether and emit a message.

– Nick ODell
2 hours ago





Stop altogether and emit a message.

– Nick ODell
2 hours ago













@Kusalananda Thanks, that was really helpful.

– Nick ODell
2 hours ago





@Kusalananda Thanks, that was really helpful.

– Nick ODell
2 hours ago










3 Answers
3






active

oldest

votes


















3














A reasonable way to test would be to compare the field using tests similar to strtod, which is the method that awk uses to convert strings to numbers:



$2 !~ / *[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


The above differs from strtod in that it does not consider INFINITY or NAN to be "numbers". The leading space requirement could be relaxed under awk's default field-splitting behavior -- meaning the fields would never contain leading space:



$2 !~ /[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


Another option would be to force a numeric conversion, then compare it to zero and then further compare the original input to zero:



{ number=0 + $2;
if (!number && $2 !~ /^[+-]?0*.?0*$/)
print "NAN: "$2;
}





share|improve this answer

































    1















    If you give it a file that doesn't have numeric data,




    $col ~ /[^-.[:digit:]]/ {print "Error, non-numeric :"; print $col; exit 1};


    Explanation just use a RegEx to check for the presence of characters which are not digits nor floating point, sign, etc.




    (or if one number is missing)




    add



    || ($col == "")


    or



    || (length($col) == 0)


    to the rule.



    Or you could use a comparison to NF if it's the last column like in your example.






    share|improve this answer








    New contributor




    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.




























      1














      I ended up with this:



      awk -v col=$col '
      typeof($col) != "strnum" {
      print "Error on line " NR ": " $col " is not numeric"
      noprint=1
      exit 1
      }
      {
      sum+=$col
      }
      END {
      if(!noprint)
      print sum
      }' $file


      This uses typeof, which is a GNU awk extension. typeof($col) returns 'strnum' if $col is a valid number, and 'string' or 'unassigned' if it is not.



      See Can I determine type of an awk variable?






      share|improve this answer























        Your Answer








        StackExchange.ready(function() {
        var channelOptions = {
        tags: "".split(" "),
        id: "106"
        };
        initTagRenderer("".split(" "), "".split(" "), channelOptions);

        StackExchange.using("externalEditor", function() {
        // Have to fire editor after snippets, if snippets enabled
        if (StackExchange.settings.snippets.snippetsEnabled) {
        StackExchange.using("snippets", function() {
        createEditor();
        });
        }
        else {
        createEditor();
        }
        });

        function createEditor() {
        StackExchange.prepareEditor({
        heartbeatType: 'answer',
        autoActivateHeartbeat: false,
        convertImagesToLinks: false,
        noModals: true,
        showLowRepImageUploadWarning: true,
        reputationToPostImages: null,
        bindNavPrevention: true,
        postfix: "",
        imageUploader: {
        brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
        contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
        allowUrls: true
        },
        onDemand: true,
        discardSelector: ".discard-answer"
        ,immediatelyShowMarkdownHelp:true
        });


        }
        });














        draft saved

        draft discarded


















        StackExchange.ready(
        function () {
        StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f494889%2fmake-awk-produce-error-on-non-numeric%23new-answer', 'question_page');
        }
        );

        Post as a guest















        Required, but never shown

























        3 Answers
        3






        active

        oldest

        votes








        3 Answers
        3






        active

        oldest

        votes









        active

        oldest

        votes






        active

        oldest

        votes









        3














        A reasonable way to test would be to compare the field using tests similar to strtod, which is the method that awk uses to convert strings to numbers:



        $2 !~ / *[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


        The above differs from strtod in that it does not consider INFINITY or NAN to be "numbers". The leading space requirement could be relaxed under awk's default field-splitting behavior -- meaning the fields would never contain leading space:



        $2 !~ /[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


        Another option would be to force a numeric conversion, then compare it to zero and then further compare the original input to zero:



        { number=0 + $2;
        if (!number && $2 !~ /^[+-]?0*.?0*$/)
        print "NAN: "$2;
        }





        share|improve this answer






























          3














          A reasonable way to test would be to compare the field using tests similar to strtod, which is the method that awk uses to convert strings to numbers:



          $2 !~ / *[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


          The above differs from strtod in that it does not consider INFINITY or NAN to be "numbers". The leading space requirement could be relaxed under awk's default field-splitting behavior -- meaning the fields would never contain leading space:



          $2 !~ /[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


          Another option would be to force a numeric conversion, then compare it to zero and then further compare the original input to zero:



          { number=0 + $2;
          if (!number && $2 !~ /^[+-]?0*.?0*$/)
          print "NAN: "$2;
          }





          share|improve this answer




























            3












            3








            3







            A reasonable way to test would be to compare the field using tests similar to strtod, which is the method that awk uses to convert strings to numbers:



            $2 !~ / *[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


            The above differs from strtod in that it does not consider INFINITY or NAN to be "numbers". The leading space requirement could be relaxed under awk's default field-splitting behavior -- meaning the fields would never contain leading space:



            $2 !~ /[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


            Another option would be to force a numeric conversion, then compare it to zero and then further compare the original input to zero:



            { number=0 + $2;
            if (!number && $2 !~ /^[+-]?0*.?0*$/)
            print "NAN: "$2;
            }





            share|improve this answer















            A reasonable way to test would be to compare the field using tests similar to strtod, which is the method that awk uses to convert strings to numbers:



            $2 !~ / *[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


            The above differs from strtod in that it does not consider INFINITY or NAN to be "numbers". The leading space requirement could be relaxed under awk's default field-splitting behavior -- meaning the fields would never contain leading space:



            $2 !~ /[+-]?[[:digit:]]/ { print "NAN: " $2; exit 1; }


            Another option would be to force a numeric conversion, then compare it to zero and then further compare the original input to zero:



            { number=0 + $2;
            if (!number && $2 !~ /^[+-]?0*.?0*$/)
            print "NAN: "$2;
            }






            share|improve this answer














            share|improve this answer



            share|improve this answer








            edited 2 hours ago

























            answered 2 hours ago









            Jeff SchallerJeff Schaller

            39.3k1054125




            39.3k1054125

























                1















                If you give it a file that doesn't have numeric data,




                $col ~ /[^-.[:digit:]]/ {print "Error, non-numeric :"; print $col; exit 1};


                Explanation just use a RegEx to check for the presence of characters which are not digits nor floating point, sign, etc.




                (or if one number is missing)




                add



                || ($col == "")


                or



                || (length($col) == 0)


                to the rule.



                Or you could use a comparison to NF if it's the last column like in your example.






                share|improve this answer








                New contributor




                DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                Check out our Code of Conduct.

























                  1















                  If you give it a file that doesn't have numeric data,




                  $col ~ /[^-.[:digit:]]/ {print "Error, non-numeric :"; print $col; exit 1};


                  Explanation just use a RegEx to check for the presence of characters which are not digits nor floating point, sign, etc.




                  (or if one number is missing)




                  add



                  || ($col == "")


                  or



                  || (length($col) == 0)


                  to the rule.



                  Or you could use a comparison to NF if it's the last column like in your example.






                  share|improve this answer








                  New contributor




                  DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                  Check out our Code of Conduct.























                    1












                    1








                    1








                    If you give it a file that doesn't have numeric data,




                    $col ~ /[^-.[:digit:]]/ {print "Error, non-numeric :"; print $col; exit 1};


                    Explanation just use a RegEx to check for the presence of characters which are not digits nor floating point, sign, etc.




                    (or if one number is missing)




                    add



                    || ($col == "")


                    or



                    || (length($col) == 0)


                    to the rule.



                    Or you could use a comparison to NF if it's the last column like in your example.






                    share|improve this answer








                    New contributor




                    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.











                    If you give it a file that doesn't have numeric data,




                    $col ~ /[^-.[:digit:]]/ {print "Error, non-numeric :"; print $col; exit 1};


                    Explanation just use a RegEx to check for the presence of characters which are not digits nor floating point, sign, etc.




                    (or if one number is missing)




                    add



                    || ($col == "")


                    or



                    || (length($col) == 0)


                    to the rule.



                    Or you could use a comparison to NF if it's the last column like in your example.







                    share|improve this answer








                    New contributor




                    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.









                    share|improve this answer



                    share|improve this answer






                    New contributor




                    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.









                    answered 2 hours ago









                    DrYakDrYak

                    1814




                    1814




                    New contributor




                    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.





                    New contributor





                    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.






                    DrYak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.























                        1














                        I ended up with this:



                        awk -v col=$col '
                        typeof($col) != "strnum" {
                        print "Error on line " NR ": " $col " is not numeric"
                        noprint=1
                        exit 1
                        }
                        {
                        sum+=$col
                        }
                        END {
                        if(!noprint)
                        print sum
                        }' $file


                        This uses typeof, which is a GNU awk extension. typeof($col) returns 'strnum' if $col is a valid number, and 'string' or 'unassigned' if it is not.



                        See Can I determine type of an awk variable?






                        share|improve this answer




























                          1














                          I ended up with this:



                          awk -v col=$col '
                          typeof($col) != "strnum" {
                          print "Error on line " NR ": " $col " is not numeric"
                          noprint=1
                          exit 1
                          }
                          {
                          sum+=$col
                          }
                          END {
                          if(!noprint)
                          print sum
                          }' $file


                          This uses typeof, which is a GNU awk extension. typeof($col) returns 'strnum' if $col is a valid number, and 'string' or 'unassigned' if it is not.



                          See Can I determine type of an awk variable?






                          share|improve this answer


























                            1












                            1








                            1







                            I ended up with this:



                            awk -v col=$col '
                            typeof($col) != "strnum" {
                            print "Error on line " NR ": " $col " is not numeric"
                            noprint=1
                            exit 1
                            }
                            {
                            sum+=$col
                            }
                            END {
                            if(!noprint)
                            print sum
                            }' $file


                            This uses typeof, which is a GNU awk extension. typeof($col) returns 'strnum' if $col is a valid number, and 'string' or 'unassigned' if it is not.



                            See Can I determine type of an awk variable?






                            share|improve this answer













                            I ended up with this:



                            awk -v col=$col '
                            typeof($col) != "strnum" {
                            print "Error on line " NR ": " $col " is not numeric"
                            noprint=1
                            exit 1
                            }
                            {
                            sum+=$col
                            }
                            END {
                            if(!noprint)
                            print sum
                            }' $file


                            This uses typeof, which is a GNU awk extension. typeof($col) returns 'strnum' if $col is a valid number, and 'string' or 'unassigned' if it is not.



                            See Can I determine type of an awk variable?







                            share|improve this answer












                            share|improve this answer



                            share|improve this answer










                            answered 2 hours ago









                            Nick ODellNick ODell

                            9942820




                            9942820






























                                draft saved

                                draft discarded




















































                                Thanks for contributing an answer to Unix & Linux Stack Exchange!


                                • Please be sure to answer the question. Provide details and share your research!

                                But avoid



                                • Asking for help, clarification, or responding to other answers.

                                • Making statements based on opinion; back them up with references or personal experience.


                                To learn more, see our tips on writing great answers.




                                draft saved


                                draft discarded














                                StackExchange.ready(
                                function () {
                                StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f494889%2fmake-awk-produce-error-on-non-numeric%23new-answer', 'question_page');
                                }
                                );

                                Post as a guest















                                Required, but never shown





















































                                Required, but never shown














                                Required, but never shown












                                Required, but never shown







                                Required, but never shown

































                                Required, but never shown














                                Required, but never shown












                                Required, but never shown







                                Required, but never shown







                                Popular posts from this blog

                                Magento 2 controller redirect on button click in phtml file

                                Polycentropodidae