Python Robotic Process Automation – Def Functions, Import Custom Modules to Create a Multi-functional Bot
Robotic process automation, or RPA is not only a technology, but also it’s a vital mindset to think of how to leverage bots that can do things like understand what’s on a screen, complete the right keystrokes, navigate systems, identify and extract data, and perform a wide range of defined actions. In Python, the def function is one of the key components to deploy, and create multi-functional bot to complete a whole process of task. So this is why the article is about today.
Chapter 75 – CRUD Notion Page Content Using Notion API & Python
ChatGPT is super blink recently because it transforms our life and work style upside down. Likey I am incline to use OpenAI API GPT3 and GPT 3.5 API as it can totally automate my life and off load repetitive work that wastes time but is critical. Using both of them is just like eating a piece of buttery and marbling rich Wagyu beef.
In fact, we never only have one option. Between API and AI chatbot, Notion AI which is using Anthropic’s Claude generative AI model can perfectly provide you semi-auto AI experience with its AI writing and API capability. Although it’s not as crunch as GPT 3, it impresses users with clear, thin and straight using experience.
In this piece, I would walk you through how to retrieve Notion AI content from Notion private page, and update new content using Notion API.
Chapter 86 – Tips to Create AMP Pages for Web App using Python, HTML, CSS, JS
AMP page weight has been downsized after Google has sunset AMP icon in SERP and the function of automatically redirecting traffic to target website page in mobile end. However, it’s still one of the most important snippets to increase exposure and grow traffic from search and discover channels as you might be aware from the search console panel..
So in this piece, I would briefly walk through how to create AMPs for your web app mobile side users usng Python as the sample. By the end of this piece, you can learn the core components and are able to start your own projects using the module in this chapter.
Chapter 85 – Guide to Deploy Web App on Google App Engine
Google Cloud offers many free resources and free quota per month. In this article, I would take Python for the instance and walk through briefly how to deploy web app on Google app engine
Chapter 63 – Company Financial News Scraper for the Top-down Analysis Using Easy2Digital News API
Industry and company up-to-date news helps you keep pace with the stock company you invested. Nevertheless, it is time consuming if you check one by one out of your investment dashboard. I daresay you feel excited if your stock dashboard can automatically refresh the company news every day using a financial news scraper. As a result, you can make decision always along with top-down industry and company news.
In this article, I’m going to introduce Easy2Digital financial news API 1.0 with the API script sample. With this API, you can build a financial news scraper for your specific collection of company symbols and integrate it with your stock monitor.
Chapter 70 – Build a Discord Bot Using Python, Hikari, Lightbulb, MongoDB
Discord is a social media platform where large numbers of people can interact in the form of a community. Currently, it’s the most harmonious platform for NFT projects as they’re community-oriented. Furthermore, the platforms facilitate NFTs trading or brand NFT marketing through their freedom communication features and integration space with Crypto wallets, such as Collabland, Metamask. Last but not least, it also facilitates NFT gating in private communities.
In this article, I would walk through how to build a discord bot to further increase communication and navigation efficiency using Python, MongoDB, Hikari, and Lightbulb.
Chapter 71 – Build Online Shop Product Detail Pages or PDP Using Flask, Javascript, Bootstrap
Product detail pages are the main functional substances for several critical purposes in business operations. Customers learn about your product and IWOM from PDPs, and it has a high weight to make customers determine whether to check out or not eventually. Online marketplace and social commerce platforms like Google Shopping, and TikTok shop open API integration for merchants to list products and generate organic traffic by connecting with PDP data feed. Marketers put effort to optimise the product conversion rate to increase investment ROI as PDP is one of the most important parts of the conversion funnel.
In this piece, I would attempt to go through how to build product detail pages in bulk using flask, Javascript, and Python from a Python developer perspective. If you are interested in building PDPs using flask, this piece would put you in the right shoes.
Chapter 69 – Build A Flask User Login System Using PyMongo
In this article, I would walk through how to use one of the MongoDB python modules – PyMongo to build a Flask user login system. The integration and development logic is similar to the one using the SQLALCHEMY database, however, there are some configuration and setting details that are unique and different from using MongoDB.
If you like to use the non-SQL database to build your Flask user login system and manage your customer database, this piece would be your cup of tea.
Chapter 26: Create a Shopify Bot Web Application Using Flask and Heroku
1.75 million merchants sell using the Shopify platform. And the company until now has a market cap of US$212.08 Billion. This makes Shopify become the most valuable company by market cap worldwide. Your competitor is using Shopify and you are curious what their activities are on-going, that includes pricing of course. Shopify Bot can be put in a more friendly and shareable format, instead of only using a raw script like Python Tutorial 10. So this is why Flask and Heroku today.
Chapter 24: Linkedin Scraper & Bot, Automate Adding Connections and Messaging
Linkedin, which is the professional networking platform, recently announced that the China version of Linkedin will sunset later this year. It’s due to a significantly more challenging operating environment and greater compliance requirement. It will launch the global standalone platform called InJobs in China. But the platform will not include a social media feed or the ability to share posts or articles. It’s what it is. Linkedin business networking is still very valuable to users, no matter whether Chinese need to use VPN to login their profiles, or inJob still has the feature of people search.
Chapter 22: Tmall & Taobao Product Scraper Using Keywords to Fetch Item Data
The COVID-19 virus hit China first and hard, but China is the fastest recovering country worldwide. Evergrand and electricity events are still creating a blurry frontpath in China. But it’s a fact that China’s economy grew by a blistering 18.3% in the first quarter of 2021 compared to 2020. A country with more than 450 million middle class citizens, Tmall and Taobao product data insight basically have become a lighthouse for sellers who are doing business in China, or are going to enter and capture some percentages of this pie.
Chapter 23: Douyin Bot & Content Scraper to Fetch Top Ranking Videos & China KOL Profiles
Douyin, which is the Chinese version of Tiktok, announced that users’ time under the age of 14 will be capped to use the app for a maximum of 40 minutes a day, and only between 6 a.m. and 10 p.m. The question is how does the system realise the signed-up users are under 14? Apparently the new policy is relying on their parents. Being said that, Douyin has averaged around 600 million daily active users, in which is accumulating many creative video content and top performing KOLs. A way to scrape scalably in bulk definitely can inspire your product development and marketing creativity.
Chapter 21: Amazon Best Selling Product Scraper to Find Niche Products, Monitor Competitors, and Identify Potential Clients
Amazon, the eCommerce giant globally, is the important lighthouse of product trend and direction to millions of sellers and hundreds of brands worldwide. Most of them are keeping eyes on the popularity of product selling and momentum of trends on Amazon. No brainer to ask a question where to find the trend? Amazon best selling products and brands is the place you should often drop by. It makes more sense if you are asking how to implement more efficiently in an automatic format. If you do, this piece can be helpful to you.
Chapter 20: Google Analytics 4 API Access Using Python to Integrate with your Custom Marketing Dashboard
Business dashboard is a must-have thing nowadays if you are running an online business. Connecting with different platforms and consolidating diverse data into one place, does help you understand a better picture. Of course, making a more proper and better decision can’t happen without an organized and up-to-date date in the dashboard.
Chapter 19: Automate Refreshing SEO Keywords Performance in Google Sheets Using Google Search Console and Easy2Digital APIs
SEO keyword insight is pretty valuable for any webmasters. The existing ranked keywords’ avg position performance month by month let you understand how’s going of your content marketing strategy. What is more, new keywords popping up in the search console inspire you with the new content perspective and long-tail keywords to utilize. It’s kind of a no-brainer, but the thing is how to organize the process and automate the process which grabs the SEO insight. This is the value you can gain from this piece.
Chapter 18: Utilize Macbook Crontab to Automate Running Amazon Competitor Price Tracker and Updating P&L Calculator and Product Market Value
Can Python really help you save a huge amount of time? The answer depends because it is not when you manually command B the script every time. It’s so manual-driven to update the pricing data using this method. This is not the purpose of the Python application. The destination picture should be someone else on behalf of you. The bot, she or he executes the Python script automatically in the background of your local device or on the cloud server.
Chapter 17: Amazon Price Tracker, Get the Up-to-date Product Market Value Using ASIN, Oauth2Client, and Google Sheet
Alert of up-to-date or even real-time product price information is indispensable if you want to keep your business and marketing in a winning position. Also, the automatic update can integrate with your eCommerce P&L calculator. That means you can see if you set the pricing too high or too low. Don’t panic when the conversion rate goes down. That might be none of your marketing strategies. Meanwhile, it might be just because of your competitor’s pricing update.
Chapter 16 – Amazon Product Scraper Using Selenium, BeautifulSoup, and Easy2Digital APIs
You might be wondering why some sellers can smell the up-to-trend niche products and make a great investment. Of course, software like Jungle Scout is assisting them to understand the target market consumers. I might partially agree because the most important is the mindset and mastering skills to automate the survey and monitoring. Instead of paying and relying on 3rd party software, self-developed amazon product scraper is indispensable if you like to stand on the front of demand, and monitor your pricing value.
Chapter 15 – Build an Instagram Photo Scraper to Grab Social Photos Using Python and OS
You might have suffered low production efficiency due to insufficient imageries and photos in your personal library. Then looking for new photos really takes time, and sometimes it’s frustrating and it can be very expensive if you pay for every piece of photo. What’s more, up-to-date and top ranking photos in instagram can inspire you with more creative content ideas. It’s worth finding a way to save time and increase the efficiency, rather than bearing with the repeating and heavy workload.
Chapter 13 – Build an Instagram Profile Scraper to Scrape Instagram Email, Followers, Posts, and More
Search keyword volume tells us the trend of up and down implying the customer end demand momentum. It reflects the information, content and products that are demandable as well. Instagram is one of the most ideal places to understand how the business creates content and engages with audiences. It’s not surprising that most people are looking for a more efficient way to fetch the data and learn insights. You can use Python, or a software, or even manually collect. The answer is obvious. It’s because good value for money and time is the evergreen strategy.
Chapter 14 – Instagram Engagement Bot Built Using Python to Boost Visibility and Grow Followers
The Instagram bot is a type of Python script that automates your interactions across Instagram profiles. Depending on the type of bot you use, they can like posts, make comments, send direct messages, and follow new profiles all on your behalf. In a way, as long as you carefully design the interaction journey, the bot can represent you to engage with Instagram users. Within 10 mins after activating the script, your Instagram might possibly generate more than 100 followers.
Chapter 12 – Build an Instagram Bot and Use Hashtags to Scrape Top Instagram Posts and Instagram Users
Instagram influencers are those users with up to hundreds, thousands, and millions of followers who are trusted by other users for their lifestyle, aesthetic, and expertise. Take fashion for example. There are so many fashion influencers, who create Livestream videos on IGTV or video posts. If you are a clothing brand marketer, scraping the profiles of famous influencers gives you candidate lists who can access a large audience of people all interested in fashion and lifestyle. For either the complimentary product review or content collaboration, it’s a great way to accumulate the influencer databases.
Also, scraping these Instagram influencers and their posts also gives you content marketing insights about what content might have better engagement with audiences. If you’re looking to strengthen your brand identity, learning from the profiles of influencers is a good place to start.
Chapter 11: Google SERP Bot to Scrape SERP Data Using Google Search and Easy2Digital APIs
I believe we can’t live without search engine channels in life and work. Depending on countries, Google, Yahoo, Naver, Baidu, and so on have been part of the body. Every coin has two sides because marketers might be suffering from overusing search engines to research the market and competitor information. We’re feeling dizzy while watching the screen in front of the laptop for a long day at work.
In this article, I would introduce you to a way to scrape all search result information by using Python, Pandas, Google custom search API, and CSE (custom search engine). By the end of this article, you just need to add keywords, you can find potential publishers, bloggers, competitors, and popular content, download the images, etc, and store the information with title, landing URL, and so on information into a local CSV.file.
Chapter 10 – Build a Shopify Bot to Scrape Store Product Data at Scale Using Easy2Digital APIs
In previous chapters, we discussed how to scrape website HTML information and Shopify product information via JSON API. Actually, on most websites and platforms, there is more than one page to show articles, products, and so on. Basically, we call it pagination, for example, page 1, or previous page or next page, and the mentioned codings and dataset only scrape the single URL page.
In this article, I would walk you through how to scrape the pagination using Python, via either the website HTML or JSON API, for the purpose to scrape all target objective information. By the end of this article, you can master Pandas library and some new methods, and you can customize the script based on your business needs.