fork download
copy 
  1. import json
  2. import re
  3.  
  4. script_content = '''<script type="application/ld+json">
  5.     {
  6.       "@context": "http://s...content-available-to-author-only...a.org",
  7.       "@type": "Product",
  8.             "description": "Hamster ve Guinea Pig için tasarlanmış temizliği kolay mama kabıdır.
  9.  
  10. Hamster motifleriyle süslü ve son derece sevimlidir.
  11.  
  12. Ürün seramikten yapılmıştır 
  13.  
  14. Ürün ölçüleri 
  15.  
  16.  
  17.     Hacim: 100 ml
  18.     Çap: 8 cm",
  19.       "name": "Karlie Seramik Hamster ve Guinea Pigler İçin Yemlik 100ml 8cm",
  20.       "image": "https://w...content-available-to-author-only...i.com/up/ecommerce/product/lg_karlie-hamster-mama-kaplari-359657192.jpg",
  21.       "brand": {
  22.         "@type": "Brand",
  23.         "name": "Karlie"
  24.       },
  25.       "category": "Guinea Pig Yemlikleri",
  26.       "sku": "4016598440834",
  27.       "gtin13": "4016598440834",
  28.       "offers": {
  29.         "@type": "Offer",
  30.          "availability": "http://s...content-available-to-author-only...a.org/InStock",
  31.          "price": "149.00",
  32.         "priceCurrency": "TRY",
  33.         "itemCondition": "http://s...content-available-to-author-only...a.org/NewCondition",
  34.         "url": "https://w...content-available-to-author-only...i.com/kemirgen-urunleri/karlie-seramik-hamster-ve-guinea-pig-mama-kabi-100ml-8cm.html"
  35.       },
  36.       "review": [
  37.             ]
  38.     }
  39.     </script>'''
  40.  
  41. json_data_match = re.search(r'<script type="application/ld\+json">(.*?)<\/script>', script_content, re.DOTALL)
  42. json_data_str = json_data_match.group(1)
  43.  
  44. json_data_str_fixed = re.sub(
  45.     r'"description": "[^"]*(\n[^"]*)*"',
  46.     lambda x: re.sub(r"\n", r"\\n", x.group(0)),
  47.     json_data_str)
  48. json_obj = json.loads(json_data_str_fixed)
  49. print('### regex result')
  50. print(json_obj)
  51. print('### json.loads(..., strict=False) result')
  52. print(json.loads(json_data_str, strict=False))
  53.  
Success #stdin #stdout 0.02s 7600KB
comments (?)
stdin
copy 
Standard input is empty
stdout
copy 
### regex result
{u'category': u'Guinea Pig Yemlikleri', u'sku': u'4016598440834', u'name': u'Karlie Seramik Hamster ve Guinea Pigler \u0130\xe7in Yemlik 100ml 8cm', u'image': u'https://w...content-available-to-author-only...i.com/up/ecommerce/product/lg_karlie-hamster-mama-kaplari-359657192.jpg', u'@type': u'Product', u'offers': {u'priceCurrency': u'TRY', u'url': u'https://w...content-available-to-author-only...i.com/kemirgen-urunleri/karlie-seramik-hamster-ve-guinea-pig-mama-kabi-100ml-8cm.html', u'price': u'149.00', u'availability': u'http://s...content-available-to-author-only...a.org/InStock', u'itemCondition': u'http://s...content-available-to-author-only...a.org/NewCondition', u'@type': u'Offer'}, u'gtin13': u'4016598440834', u'review': [], u'@context': u'http://s...content-available-to-author-only...a.org', u'brand': {u'@type': u'Brand', u'name': u'Karlie'}, u'description': u'Hamster ve Guinea Pig i\xe7in tasarlanm\u0131\u015f temizli\u011fi kolay mama kab\u0131d\u0131r.\n\nHamster motifleriyle s\xfcsl\xfc ve son derece sevimlidir.\n\n\xdcr\xfcn seramikten yap\u0131lm\u0131\u015ft\u0131r \n\n\xdcr\xfcn \xf6l\xe7\xfcleri \n\n\n    Hacim: 100 ml\n    \xc7ap: 8 cm'}
### json.loads(..., strict=False) result
{u'category': u'Guinea Pig Yemlikleri', u'sku': u'4016598440834', u'name': u'Karlie Seramik Hamster ve Guinea Pigler \u0130\xe7in Yemlik 100ml 8cm', u'image': u'https://w...content-available-to-author-only...i.com/up/ecommerce/product/lg_karlie-hamster-mama-kaplari-359657192.jpg', u'@type': u'Product', u'offers': {u'priceCurrency': u'TRY', u'url': u'https://w...content-available-to-author-only...i.com/kemirgen-urunleri/karlie-seramik-hamster-ve-guinea-pig-mama-kabi-100ml-8cm.html', u'price': u'149.00', u'availability': u'http://s...content-available-to-author-only...a.org/InStock', u'itemCondition': u'http://s...content-available-to-author-only...a.org/NewCondition', u'@type': u'Offer'}, u'gtin13': u'4016598440834', u'review': [], u'@context': u'http://s...content-available-to-author-only...a.org', u'brand': {u'@type': u'Brand', u'name': u'Karlie'}, u'description': u'Hamster ve Guinea Pig i\xe7in tasarlanm\u0131\u015f temizli\u011fi kolay mama kab\u0131d\u0131r.\n\nHamster motifleriyle s\xfcsl\xfc ve son derece sevimlidir.\n\n\xdcr\xfcn seramikten yap\u0131lm\u0131\u015ft\u0131r \n\n\xdcr\xfcn \xf6l\xe7\xfcleri \n\n\n    Hacim: 100 ml\n    \xc7ap: 8 cm'}
https://ideone.com/okXYok
https://stackoverflow.com/questions/77840468/unwanted-newline-characters-in-json-while-web-scraping
language:
Python (cpython 2.7.16)
created:
1 year ago
visibility:
secret

Share or Embed source code

Discover > Sphere Engine API

The brand new service which powers Ideone!

Discover > IDE Widget

Widget for compiling and running the source code in a web browser!