Using aws glue to update existing DB table rows

Not directly, you would need to write into a temporary table and then issue a SQL query (using JDBC or a Python library) to merge with the final table.