Automation




Python Tutorial for Digital Marketers 10 – Python Web Scraping – Pagination and Shopify Product Pages

In previous chapters, we discussed how to scrape website HTML information and Shopify product information via JSON API. Actually, on most websites and platforms, there is more than one page to show articles, products, and so on. Basically, we call it pagination, for example, page 1, or previous page or next page, and the mentioned codings and dataset only scrape the single URL page.

In this article, I would walk you through how to scrape the pagination using Python, via either the website HTML or JSON API, for the purpose to scrape all target objective information. By the end of this article, you can master Pandas library and some new methods, and you can customize the script based on your business needs.

Personalize & Automate Email Outreach and Communication Using Gmail, GMass, Google Sheets

Trying to imagine you have scraped plenty of business email addresses by using Python, that is from potential influencers and partners who might collaborate with your business and help build the brand and increase the sales. It can be super busy and overwhelming work if you try to outreach one by one and personalize the business email communication via email. Even though you can pay for an email software or outsource to a 3rd party service provider, the cost is a matter as well. 

In this article, I’ll introduce an extension called GMass, which you can use with Gmail and Google Sheets that can integrate with your Python scraper scripts, so that you can consolidate all email addresses in Google sheet and personalize the messages by using columns before sending out, and track the responsive performance, then implement automatic follow-up. By the end of this one, you can master how to just click one button and send out numbers of personalized emails.

Python Tutorial for Digital Marketers 9: Big Picture Matters, How to Pull Data from Google Trends API via Pytrends

In the previous Python Tutorial for digital marketers, I talked about leveraging Shopify APIs to scrape the competitors’ product feed and monitor up-to-trend products and pricing from there, for the purpose to adjust tactics and keep your business cutting-edge from the same selling marketplaces.

In a way, the product feed is not sufficient to understand the market demand, because you might not want to anchor a dot, where they’re selling low-demand products, or the product trend has been going down. Then, unfortunately, you test along with these sellers and lose money at the end, because you just follow without further step analyzing the big picture.

The big picture is critical in the business battleground, and the end consumer search trend is a key implication to tell you how’s the demand going out there, and what topics they are looking for.

In this piece of Python Tutorial, I would walk through how to pull search data from Google Trends API via Pytrends, then people can learn the data that is integrated with your in-house database, and identify the opportunities. By the end of this Python Tutorial, you can master how to install Pytrends and necessary modules, what available API methods and parameters you can leverage to scrape available data, and custom the data sheet based on actual needs.

Python Tutorial for Digital Marketers 8: One Script to Scrape Competitor Shopify Web Product Data

Previously, I talked about how to store all fetched data in the Google sheet in your Google drive, which you are not limited to your local computer or laptop to open the data, or your partners can open it to work for projects anytime.

When talking about digital and eCommerce projects, the Shopify project must be one of the most popular topics which many eCommerce sellers like to discuss. If you don’t believe me, please just check out the Shopify stock pricing and ask your surroundings how many sellers are significantly benefiting from Shopify, thanks to easy-to-use and super agile features. The fragment eCommerce era has come, creating an online store is as easy as creating a blog.
So in this Python Tutorial, I’ll walk you through how to create a Python script and scrape any Shopify website product data just by changing a website URL. By the end of this piece, you can learn how to find Shopify storefront API and read Shopify JSON, then write the python codes for specific product information, such as title, price, compared price, etc, as long as Shopify product data includes in the JSON format.

Python Tutorial for Digital Marketers 7: Save Web Scraping Data in Google Sheet via API

In the previous Python Tutorial, we talked about how to scrape more than 50 videos from a Youtube search query keyword, and also grab the performance of each video, such as view, comment, like, etc. However, it’s not the end of automation power, like saying you aim to research, filter Youtubers, and automate the collaboration invitation process. At least, the fetched list of Youtubers should be saved and managed in a datasheet on a cloud drive instead of in the CSV file, that can be set up and easily integrated with other platforms.

So in this Python Tutorial, I will continue to use the Python script from the Python Tutorial Chapter 6, and walk you through how to create a Robot user account, leverage Google Sheet API to save all fetched data in a Google Sheet In your web scraping python script. By the end of this Python Tutorial, you can learn what modules you need to set up, and experience just looking at a spreadsheet that is automatically listing all videos in a preset format.

Python Tutorial for Digital Marketers 6: Scrape View, Comment, Like Data of More than 50 Videos from the Youtube Search List

In the previous Python Tutorial, I walked you through how to create a youtube API key and scrape videos by search queries via python programming. Basically, the beauty of youtube video scraping is you don’t need to pay any fees to research potential YouTubers for your brand and eCommerce store product review, which is a super-efficient way.

But having said that for filtering the better YouTubers, it’s not sufficient for us to select just by those fetched videos, on the other hand, we also need to look into the video data, such as view, comments, likes, dislikes, etc, which can help us make a better candidate list. Also, by default Youtube data API v3 allows developers to scrape the top 50 pieces of videos, I would say it might be not enough because you might miss some secondary tier YouTubers whose videos might rank lower positions, but the content is pretty good and engaging.

As I haven’t talked about how to fetch those data above, so in this piece, I’ll continue to use the previous Youtube video scraping python script, and walk you through Youtube data API video data, how to write the codes to fetch the data, and scrape more than 50 pieces of videos from the search query result.

Mailchimp vs Omnisend? Which Marketing Automation Platform Is Better for the eCommerce

Email and marketing automation would continue as one of the major traffic and revenue sources for any online sellers and eCommerce store owners. In particular, with more revolutionizing messaging and texting channels, such as WhatsApp, live chat, etc, and personally, I believe it would just have more channels. So it would become one of the key channels to drive new customers who are from the middle-funnel of a customer purchase journey and extend customer lifetime value through an efficient and considering conversational marketing strategy. There is a statistic according to a study, worldwide email users are set to grow to 4.3 billion users in 2023.

There is some free software such as GMass, Shopify email out there. They’re very helpful and I’m also using them if my purpose is to automate the email blast process, but marketing automation platforms are not just a tool of sending emails and automating the followings. So in this article, I’ll review 2 marketing automation platforms, which are Omnisend and Mailchimp from 6 perspectives. By the end of the piece, you can learn which one is better to start for your eCommerce business, and which one price is more reasonable with a similar set of the scope of service.

Python Tutorial for Digital Marketers 5: Create Youtube API & Scrape Youtube Videos

Previously we took Ring.com website as an example, and walked you through how to specify Ring product price data to scrape and save the bulk of data in local drive. Basically, the script code can scrape any general websites that are built and developed by CMS, such as WordPress, Shopify, etc. If you want to have a copy of the python script file, please contact us.

Being said that, not all the websites can be indexable and crawlable, because the data feed from some websites can be only accessible via API, such as Youtube, Facebook, Amazon, etc. Frankly if you just want to scrape these sites’ data by URL, I suggest you leverage Google Sheet importxml instead of Python, because it’s much easier (Time is money). On the other hand, automation and bulk amount of scraping data work are your regular work, for example, if you are a social media marketer, you need to recruit influencers, or KOLs, the following a series of articles can help relieve your stress and repeating manual work.

We would start with Youtube video scraping first, and by the end of this article, you can learn how to install Youtube API key, and what give methods you can use by Youtube API, how to scrape youtube videos, and video analytic data in bulk.

1 2 5