Chapter 74 – Flask App Dynamic Sitemap XML Using MongoDB
What a freezing day is like if you build a sitemap and update time by time manually. Or paying for a recurring monthly subscription for just a second work one-off is not a smart decision as well.
If you are looking for a better way like the feeling of eating better marbling beef meat, this piece is here for you. This article is going to talk about developing dynamic sitemap xml for your Flask App. Let’s go!
JSON vs YAML, Which Data Serialization Is Better?
Any developers or programmers, or even marketers would not feel strange to a data type – JSON. It’s one of the most popular and awesome data serialization language. In fact, there is an alternative called YAML. I believe people who is famiilar with Google ads API must know this data type. In this Python knowledge hub, I would elaborate what are their pros and cons respectively, and how you can better leverage them as a developer and marketer.
Google Sheets ImportXML – Automatically Scrape Web and Collect Product Price Info
I am always on the lookout for a unique angle to use freely available or potentially scrapable data sources. Also, It’s indeed frustrating that you have, admittedly, spent hours upon hours trying to learn Python for writing simple web scraper applications, and implementing web scraping automatically, however, at the end you can only discover the data isn’t accessible, interesting or differentiated enough from what’s already out there.
If you just want to automate updating the profit calculator of your eCommerce business, thankfully, there is an easier way to collect data from the web without spending that much hours: Google Sheets ImportXML Function.
Chapter 76 – Generate the Object Feature Importance Using Scikit learn and Random Forest
The random forest algorithm has been applied across a number of industries, allowing them to make better business decisions. Some use cases include high credit risk analysis and product recommendation for cross-sell purposes.
In this piece, I would briefly walk you through several methods of generating feature importance by using classic red wine quality validator dataset. By the end of this chapter, you can have a basic concept to use Random forest applied to your projects and compare the result amongst different methods.
Python Robotic Process Automation – Def Functions, Import Custom Modules to Create a Multi-functional Bot
Robotic process automation, or RPA is not only a technology, but also it’s a vital mindset to think of how to leverage bots that can do things like understand what’s on a screen, complete the right keystrokes, navigate systems, identify and extract data, and perform a wide range of defined actions. In Python, the def function is one of the key components to deploy, and create multi-functional bot to complete a whole process of task. So this is why the article is about today.
Chapter 75 – CRUD Notion Page Content Using Notion API & Python
ChatGPT is super blink recently because it transforms our life and work style upside down. Likey I am incline to use OpenAI API GPT3 and GPT 3.5 API as it can totally automate my life and off load repetitive work that wastes time but is critical. Using both of them is just like eating a piece of buttery and marbling rich Wagyu beef.
In fact, we never only have one option. Between API and AI chatbot, Notion AI which is using Anthropic’s Claude generative AI model can perfectly provide you semi-auto AI experience with its AI writing and API capability. Although it’s not as crunch as GPT 3, it impresses users with clear, thin and straight using experience.
In this piece, I would walk you through how to retrieve Notion AI content from Notion private page, and update new content using Notion API.
Chapter 86 – Tips to Create AMP Pages for Web App using Python, HTML, CSS, JS
AMP page weight has been downsized after Google has sunset AMP icon in SERP and the function of automatically redirecting traffic to target website page in mobile end. However, it’s still one of the most important snippets to increase exposure and grow traffic from search and discover channels as you might be aware from the search console panel..
So in this piece, I would briefly walk through how to create AMPs for your web app mobile side users usng Python as the sample. By the end of this piece, you can learn the core components and are able to start your own projects using the module in this chapter.
Chapter 85 – Guide to Deploy Web App on Google App Engine
Google Cloud offers many free resources and free quota per month. In this article, I would take Python for the instance and walk through briefly how to deploy web app on Google app engine
Chapter 63 – Company Financial News Scraper for the Top-down Analysis Using Easy2Digital News API
Industry and company up-to-date news helps you keep pace with the stock company you invested. Nevertheless, it is time consuming if you check one by one out of your investment dashboard. I daresay you feel excited if your stock dashboard can automatically refresh the company news every day using a financial news scraper. As a result, you can make decision always along with top-down industry and company news.
In this article, I’m going to introduce Easy2Digital financial news API 1.0 with the API script sample. With this API, you can build a financial news scraper for your specific collection of company symbols and integrate it with your stock monitor.
Chapter 70 – Build a Discord Bot Using Python, Hikari, Lightbulb, MongoDB
Discord is a social media platform where large numbers of people can interact in the form of a community. Currently, it’s the most harmonious platform for NFT projects as they’re community-oriented. Furthermore, the platforms facilitate NFTs trading or brand NFT marketing through their freedom communication features and integration space with Crypto wallets, such as Collabland, Metamask. Last but not least, it also facilitates NFT gating in private communities.
In this article, I would walk through how to build a discord bot to further increase communication and navigation efficiency using Python, MongoDB, Hikari, and Lightbulb.
Chapter 71 – Build Online Shop Product Detail Pages or PDP Using Flask, Javascript, Bootstrap
Product detail pages are the main functional substances for several critical purposes in business operations. Customers learn about your product and IWOM from PDPs, and it has a high weight to make customers determine whether to check out or not eventually. Online marketplace and social commerce platforms like Google Shopping, and TikTok shop open API integration for merchants to list products and generate organic traffic by connecting with PDP data feed. Marketers put effort to optimise the product conversion rate to increase investment ROI as PDP is one of the most important parts of the conversion funnel.
In this piece, I would attempt to go through how to build product detail pages in bulk using flask, Javascript, and Python from a Python developer perspective. If you are interested in building PDPs using flask, this piece would put you in the right shoes.
Chapter 69 – Build A Flask User Login System Using PyMongo
In this article, I would walk through how to use one of the MongoDB python modules – PyMongo to build a Flask user login system. The integration and development logic is similar to the one using the SQLALCHEMY database, however, there are some configuration and setting details that are unique and different from using MongoDB.
If you like to use the non-SQL database to build your Flask user login system and manage your customer database, this piece would be your cup of tea.
Chapter 23: Douyin Bot & Content Scraper to Fetch Top Ranking Videos & China KOL Profiles
Douyin, which is the Chinese version of Tiktok, announced that users’ time under the age of 14 will be capped to use the app for a maximum of 40 minutes a day, and only between 6 a.m. and 10 p.m. The question is how does the system realise the signed-up users are under 14? Apparently the new policy is relying on their parents. Being said that, Douyin has averaged around 600 million daily active users, in which is accumulating many creative video content and top performing KOLs. A way to scrape scalably in bulk definitely can inspire your product development and marketing creativity.
Chapter 21: Amazon Best Selling Product Scraper to Find Niche Products, Monitor Competitors, and Identify Potential Clients
Amazon, the eCommerce giant globally, is the important lighthouse of product trend and direction to millions of sellers and hundreds of brands worldwide. Most of them are keeping eyes on the popularity of product selling and momentum of trends on Amazon. No brainer to ask a question where to find the trend? Amazon best selling products and brands is the place you should often drop by. It makes more sense if you are asking how to implement more efficiently in an automatic format. If you do, this piece can be helpful to you.
Chapter 20: Google Analytics 4 API Access Using Python to Integrate with your Custom Marketing Dashboard
Business dashboard is a must-have thing nowadays if you are running an online business. Connecting with different platforms and consolidating diverse data into one place, does help you understand a better picture. Of course, making a more proper and better decision can’t happen without an organized and up-to-date date in the dashboard.
Chapter 19: Automate Refreshing SEO Keywords Performance in Google Sheets Using Google Search Console and Easy2Digital APIs
SEO keyword insight is pretty valuable for any webmasters. The existing ranked keywords’ avg position performance month by month let you understand how’s going of your content marketing strategy. What is more, new keywords popping up in the search console inspire you with the new content perspective and long-tail keywords to utilize. It’s kind of a no-brainer, but the thing is how to organize the process and automate the process which grabs the SEO insight. This is the value you can gain from this piece.
Chapter 18: Utilize Macbook Crontab to Automate Running Amazon Competitor Price Tracker and Updating P&L Calculator and Product Market Value
Can Python really help you save a huge amount of time? The answer depends because it is not when you manually command B the script every time. It’s so manual-driven to update the pricing data using this method. This is not the purpose of the Python application. The destination picture should be someone else on behalf of you. The bot, she or he executes the Python script automatically in the background of your local device or on the cloud server.
Chapter 17: Amazon Price Tracker, Get the Up-to-date Product Market Value Using ASIN, Oauth2Client, and Google Sheet
Alert of up-to-date or even real-time product price information is indispensable if you want to keep your business and marketing in a winning position. Also, the automatic update can integrate with your eCommerce P&L calculator. That means you can see if you set the pricing too high or too low. Don’t panic when the conversion rate goes down. That might be none of your marketing strategies. Meanwhile, it might be just because of your competitor’s pricing update.
Chapter 16 – Amazon Product Scraper Using Selenium, BeautifulSoup, and Easy2Digital APIs
You might be wondering why some sellers can smell the up-to-trend niche products and make a great investment. Of course, software like Jungle Scout is assisting them to understand the target market consumers. I might partially agree because the most important is the mindset and mastering skills to automate the survey and monitoring. Instead of paying and relying on 3rd party software, self-developed amazon product scraper is indispensable if you like to stand on the front of demand, and monitor your pricing value.
Chapter 15 – Build an Instagram Photo Scraper to Grab Social Photos Using Python and OS
You might have suffered low production efficiency due to insufficient imageries and photos in your personal library. Then looking for new photos really takes time, and sometimes it’s frustrating and it can be very expensive if you pay for every piece of photo. What’s more, up-to-date and top ranking photos in instagram can inspire you with more creative content ideas. It’s worth finding a way to save time and increase the efficiency, rather than bearing with the repeating and heavy workload.
Chapter 13 – Build an Instagram Profile Scraper to Scrape Instagram Email, Followers, Posts, and More
Search keyword volume tells us the trend of up and down implying the customer end demand momentum. It reflects the information, content and products that are demandable as well. Instagram is one of the most ideal places to understand how the business creates content and engages with audiences. It’s not surprising that most people are looking for a more efficient way to fetch the data and learn insights. You can use Python, or a software, or even manually collect. The answer is obvious. It’s because good value for money and time is the evergreen strategy.
Chapter 14 – Instagram Engagement Bot Built Using Python to Boost Visibility and Grow Followers
The Instagram bot is a type of Python script that automates your interactions across Instagram profiles. Depending on the type of bot you use, they can like posts, make comments, send direct messages, and follow new profiles all on your behalf. In a way, as long as you carefully design the interaction journey, the bot can represent you to engage with Instagram users. Within 10 mins after activating the script, your Instagram might possibly generate more than 100 followers.
Chapter 12 – Build an Instagram Bot and Use Hashtags to Scrape Top Instagram Posts and Instagram Users
Instagram influencers are those users with up to hundreds, thousands, and millions of followers who are trusted by other users for their lifestyle, aesthetic, and expertise. Take fashion for example. There are so many fashion influencers, who create Livestream videos on IGTV or video posts. If you are a clothing brand marketer, scraping the profiles of famous influencers gives you candidate lists who can access a large audience of people all interested in fashion and lifestyle. For either the complimentary product review or content collaboration, it’s a great way to accumulate the influencer databases.
Also, scraping these Instagram influencers and their posts also gives you content marketing insights about what content might have better engagement with audiences. If you’re looking to strengthen your brand identity, learning from the profiles of influencers is a good place to start.
Chapter 11: Google SERP Bot to Scrape SERP Data Using Google Search and Easy2Digital APIs
I believe we can’t live without search engine channels in life and work. Depending on countries, Google, Yahoo, Naver, Baidu, and so on have been part of the body. Every coin has two sides because marketers might be suffering from overusing search engines to research the market and competitor information. We’re feeling dizzy while watching the screen in front of the laptop for a long day at work.
In this article, I would introduce you to a way to scrape all search result information by using Python, Pandas, Google custom search API, and CSE (custom search engine). By the end of this article, you just need to add keywords, you can find potential publishers, bloggers, competitors, and popular content, download the images, etc, and store the information with title, landing URL, and so on information into a local CSV.file.