Data Collection for Product Managers

Data Science Tech Brief By HackerNoon

Player FM - Internet Radio Done Right

הוסף לפני two שנים

תוכן מסופק על ידי HackerNoon. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי HackerNoon או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.

This Is Woman's Work with Nicole Kalil

1
Confidence Isn’t Born, It’s Built — Lessons from the Cockpit to Real Life with Michelle “MACE” Curran | 343 39:28

לפני 8 weeks39:28

הפעל מאוחר יותר

רשימות

לייק

אהבתי

39:28

Confidence. Courage. Boldness. We love to talk about them, post about them, hashtag them, and slap them on coffee mugs. But let’s be real—most of us aren’t sure how to actually build them in our own lives. Which is why we brought in Michelle “MACE” Curran , former fighter pilot and only the second woman in history to fly lead solo for the U.S. Air Force Thunderbirds, to the show. Yep, she’s the real deal—flying combat missions, performing death-defying maneuvers in front of millions, and now, author of The Flip Side: How to Invert Your Perspective and Turn Fear into Your Superpower. Mace knows better than anyone that courage and confidence don’t just magically appear. They’re built, brick by brick, in moments that test your nerve—whether that’s hitting nine G’s at supersonic speed or simply raising your hand in a room full of skeptics. In this episode, she drops a masterclass on how to flip fear on its head, use it as fuel, and create unshakable boldness in your everyday life. Connect with Michelle: Website: www.macecurran.com Book: www.macecurran.com/flipside IG : https://www.instagram.com/mace_curran/?hl=en LI: https://www.linkedin.com/in/macecurran Related Podcast Episodes Chasing Rejection: The Wild Strategy That Works with Alice Draper | 316 Unlocking Your Hidden Genius: How to Harness Your Innate Talents with Betsy Wills & Alex Ellison | Ep. 289 How To Build Courage with Dr. Margie Warrell | 273 Share the Love: If you found this episode insightful, please share it with a friend, tag us on social media, and leave a review on your favorite podcast platform! 🔗 Subscribe & Review: Apple Podcasts | Spotify | Amazon Music Learn more about your ad choices. Visit megaphone.fm/adchoices…

לפני שנה 7:55

MP3•בית הפרקים

This story was originally published on HackerNoon at: https://hackernoon.com/data-collection-for-product-managers.
Discover how product managers can bridge the gap between intuition and data to optimize product improvement with best practices and real-world examples.
Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-collection, #startups, #data-product-management, #data-driven-insights, #data-driven-decision-making, #product-manager, #product-management-tips, #how-to-collect-data, and more.
This story was written by: @carolinagarcia. Learn more about this writer by checking @carolinagarcia's about page, and for more stories, please visit hackernoon.com.
Discover how product managers can bridge the gap between intuition and data to optimize product improvement. This guide explores the importance of data-driven decision-making, offering best practices and real-world examples from companies like NuBank, Monzo, Deliveroo, and Booking.com. Learn how to acquire insights from customer feedback, track performance metrics, monitor market trends, and refine product roadmaps through iterative experimentation. Become a data-driven PM and create products that users will love.

142 פרקים

#News #Tech News #HackerNoon

Data Science Tech Brief By HackerNoon

Data Collection for Product Managers

Data Science Tech Brief By HackerNoon

published לפני שנה

שתפו

MP3•בית הפרקים

142 פרקים

#News #Tech News #HackerNoon

כל הפרקים

Data Science Tech Brief By HackerNoon

1
From Data Fragmentation to Billion-Dollar Insights: The Vision of Manish Ravindra Sharath 7:19

לפני 6 ימים7:19

7:19

This story was originally published on HackerNoon at: https://hackernoon.com/from-data-fragmentation-to-billion-dollar-insights-the-vision-of-manish-ravindra-sharath . Manish Ravindra Sharath unified fragmented enterprise data using PySpark & cloud-native systems,boosting efficiency 99% and driving multimillion-dollar growth. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #enterprise-data-engineering , #manish-ravindra-sharath , #pyspark-data-pipeline , #cloud-data-architecture , #data-modernization-strategy , #hybrid-data-infrastructure , #enterprise-analytics , #good-company , and more. This story was written by: @sanya_kapoor . Learn more about this writer by checking @sanya_kapoor's about page, and for more stories, please visit hackernoon.com . Manish Ravindra Sharath transformed enterprise decision-making by architecting a unified PySpark-powered data pipeline that cut reporting time from 30+ hours to 30 minutes. His system achieved 99% efficiency, 40% cost reduction, and 30% faster deal closures—turning fragmented data into billion-dollar insights driving global business performance.…

Data Science Tech Brief By HackerNoon

1
Building a Layered Defense Against Web Scraping 8:43

לפני 6 ימים8:43

8:43

This story was originally published on HackerNoon at: https://hackernoon.com/building-a-layered-defense-against-web-scraping . Discover how a three-layer data-protection model blends AI, risk-based gating, and legal context to stop web scraping while preserving user trust. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #web-scraping , #data-protection , #ai-security , #product-strategy , #web-scraping-protection , #bot-mitigation , #risk-based-gating , #data-security-strategy , and more. This story was written by: @areejit1 . Learn more about this writer by checking @areejit1's about page, and for more stories, please visit hackernoon.com . The web-scraping industry is no longer niche. Valued at USD 1.03 billion in 2025, it is projected to nearly double by 2030. Traditional defenses rate limiting, CAPTCHAs, IP bans are brittle against modern toolkits. A layered defense acknowledges this tension.…

Data Science Tech Brief By HackerNoon

1
Cosmo: The Graph Visualization Tool Built for Your Terminal 2:56

לפני 13 ימים2:56

2:56

This story was originally published on HackerNoon at: https://hackernoon.com/cosmo-the-graph-visualization-tool-built-for-your-terminal . Cosmo is a terminal-based interactive graph visualizer that automatically layouts and displays complex data structures for quick exploration. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #visualization , #terminal , #cli , #graphs , #tui , #cosmo , #complex-data-structures , #gui-visualizer , and more. This story was written by: @hacker227143 . Learn more about this writer by checking @hacker227143's about page, and for more stories, please visit hackernoon.com . Cosmo is a fast, interactive graph visualizer that makes graphs and trees easy to understand, beautifully arranged, and fully explorable without ever leaving your command line. Pass your data structures directly from code or file and see them come to life.…

Data Science Tech Brief By HackerNoon

1
How Businesses Are Turning Space Data into a Tool for Risk, Resilience, and Sustainability 6:06

לפני 21 ימים6:06

6:06

This story was originally published on HackerNoon at: https://hackernoon.com/how-businesses-are-turning-space-data-into-a-tool-for-risk-resilience-and-sustainability . Satellites are reshaping insurance, supply chains, and sustainability—here’s how space data became core to global business strategy. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #business-intelligence , #space-economy , #satellite-data , #sustainability-reporting , #supply-chain-analytics , #geospatial-intelligence , #space-technology , #earth-observation , and more. This story was written by: @150sec . Learn more about this writer by checking @150sec's about page, and for more stories, please visit hackernoon.com . The global space economy is evolving from exploration to infrastructure. Businesses across insurance, sustainability, and supply chains now rely on satellite data for real-time insights that help manage risk, track biodiversity, forecast disruptions, and meet new reporting standards. As costs drop and access expands, space data has become an essential layer of corporate intelligence—turning orbit into opportunity.…

Data Science Tech Brief By HackerNoon

1
How Data Innovation Changed a State’s Infrastructure Engine 7:44

לפני 26 ימים7:44

7:44

This story was originally published on HackerNoon at: https://hackernoon.com/how-data-innovation-changed-a-states-infrastructure-engine . Deepak Chanda modernized Massachusetts’ infrastructure systems through data-driven process innovation—turning inefficiency into lasting operational reform. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-innovation-in-government , #infrastructure-analytics , #data-transformation , #process-automation , #massachusetts-transportation , #sql-data-pipeline-optimization , #real-time-anomaly-detection , #good-company , and more. This story was written by: @jonstojanjournalist . Learn more about this writer by checking @jonstojanjournalist's about page, and for more stories, please visit hackernoon.com . Amid bureaucratic stagnation in Massachusetts’ public works, Senior Data Analyst Deepak Chanda led a quiet revolution. By digitizing blueprint reviews and adding a simple SQL field to track project sign-offs, he cut delays and saved taxpayer dollars. His philosophy—good data should shape the world, not just describe it—continues to drive progress across healthcare and insurance.…

Data Science Tech Brief By HackerNoon

1
How to Optimize Your Marketing Budget Using Just Three Letters: MMM 7:26

לפני 6 weeks7:26

7:26

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-optimize-your-marketing-budget-using-just-three-letters-mmm . Marketing Mix Modeling is a statistical analysis method used in marketing to determine the optimal allocation of resources. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #marketing-analytics , #machine-learning , #marketing , #marketing-budget , #marketing-mix-modeling , #media-mix-modelling , #adstock-and-saturation , and more. This story was written by: @radiokocmoc_l45iej08 . Learn more about this writer by checking @radiokocmoc_l45iej08's about page, and for more stories, please visit hackernoon.com . Marketing Mix Modeling is a statistical analysis method used in marketing to determine the optimal allocation of resources. The goal of media mix modelling is to understand the impact of different marketing channels on the overall campaign effectiveness. Join me to discover how to optimise the marketing budget by implementing Robyn MMM.…

Data Science Tech Brief By HackerNoon

1
Here's How ShareChat Scaled Their ML Feature Store 1000X Without Scaling the Database 12:42

לפני 6 weeks12:42

12:42

This story was originally published on HackerNoon at: https://hackernoon.com/heres-how-sharechat-scaled-their-ml-feature-store-1000x-without-scaling-the-database . How ShareChat scaled its ML feature store to 1B features/sec on ScyllaDB, achieving 1000X performance without scaling the database. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #sharechat-ml-feature-store , #scylladb-scaling-case-study , #ml-feature-store-optimization , #sharechat-moj , #low-latency-ml-infrastructure , #scylladb-database-optimization , #p99-conf-sharechat-talk , #good-company , and more. This story was written by: @scylladb . Learn more about this writer by checking @scylladb's about page, and for more stories, please visit hackernoon.com . ShareChat scaled its ML feature store from failure at 1M features/sec to 1B features/sec using ScyllaDB optimizations, caching hacks, and relentless tuning. By rethinking schemas, tiling, and caching strategies, engineers avoided scaling the database, cut latency, and boosted cache hit rates—proving performance engineering beats brute-force scaling.…

Data Science Tech Brief By HackerNoon

1
Why You Shouldn’t Judge by PnL Alone 13:23

לפני 6 weeks13:23

13:23

This story was originally published on HackerNoon at: https://hackernoon.com/why-you-shouldnt-judge-by-pnl-alone . PnL can lie. This hands-on guide shows traders how hypothesis testing separate luck from edge, with a Python example and tips on how not to fool yourself. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #quantitative-research , #trading , #algorithmic-trading , #pnl , #udge-pnl , #profit-and-loss , #judge-profit-and-loss , #hackernoon-top-story , and more. This story was written by: @ruslan4ezzz . Learn more about this writer by checking @ruslan4ezzz's about page, and for more stories, please visit hackernoon.com . I’ve spent years building and evaluating systematic strategies across highly adversarial markets. When you iterate on a trading system, PnL is the goal but a terrible day-to-day signal. It’s too noisy, too path-dependent, and too easy to cherry-pick. A simple framework—form a hypothesis, measure a test statistic, translate it into a probability under a “no-effect” world (the p-value)—helps you avoid false wins, iterate faster, and ship changes that actually stick. Below I’ll show a concrete example where two strategies look very different in cumulative PnL charts, yet standard tests say there’s no meaningful difference in their average per-trade outcome. I’ll also demystify the t-test in plain language: difference of means, scaled by uncertainty.…

Data Science Tech Brief By HackerNoon

1
From "Decentralized" to "Unified": SUPCON Uses SeaTunnel to Build an Efficient Data Collection Frame 16:17

לפני 6 weeks16:17

16:17

This story was originally published on HackerNoon at: https://hackernoon.com/from-decentralized-to-unified-supcon-uses-seatunnel-to-build-an-efficient-data-collection-frame . SUPCON dumped siloed data tools for Apache SeaTunnel—now core sync tasks run 0-failure! Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #bigdata , #apacheseatunnel , #supcon , #data-sync , #high-availability , #data-engineering , #cdc , #hackernoon-top-story , and more. This story was written by: @williamguo . Learn more about this writer by checking @williamguo's about page, and for more stories, please visit hackernoon.com . 99% lower failures, 100% consistency, 70% less O&M cost. Big thanks to @ApacheSeaTunnel!…

Data Science Tech Brief By HackerNoon

1
Enterprise Data Pipeline Revolution: Suresh Palli's Metadata-Driven Automation Success 7:50

לפני 7 weeks7:50

7:50

This story was originally published on HackerNoon at: https://hackernoon.com/enterprise-data-pipeline-revolution-suresh-pallis-metadata-driven-automation-success . Suresh Palli revolutionized enterprise data pipelines with metadata-driven automation, cutting dev time 40% and boosting scalability 5x. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #suresh-palli , #metadata-driven-automation , #enterprise-data-pipelines , #data-pipeline-automation , #metadata-governance , #enterprise-data-architecture , #scalable-data-processing , #good-company , and more. This story was written by: @sanya_kapoor . Learn more about this writer by checking @sanya_kapoor's about page, and for more stories, please visit hackernoon.com . Suresh Palli led a metadata-driven automation project that cut pipeline development time by 40% and scaled data processing 5x. His centralized metadata governance enabled dynamic adaptation, seamless orchestration, and cross-unit alignment. The success earned industry recognition, consulting opportunities, and set new benchmarks for enterprise data automation.…

Data Science Tech Brief By HackerNoon

1
Unified Data, Smarter Agents—Is Your Architecture Future-Proof? 7:51

לפני 7 weeks7:51

7:51

This story was originally published on HackerNoon at: https://hackernoon.com/unified-data-smarter-agentsis-your-architecture-future-proof . A hands-on guide to architecting unified, governed and AI-ready data platforms using open table formats, semantic layers and multicloud governance. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data , #big-data-analytics , #product , #ai , #etl , #azure , #aws , #data-engineering , and more. This story was written by: @@QueryAndConquer . Learn more about this writer by checking @@QueryAndConquer's about page, and for more stories, please visit hackernoon.com . A hands-on guide to architecting unified, governed and AI-ready data platforms using open table formats, semantic layers and multicloud governance.…

Data Science Tech Brief By HackerNoon

1
Data-Driven Decisions at Scale: A/B Testing Best Practices for Engineering & Data Science Teams 5:59

לפני 7 weeks5:59

5:59

This story was originally published on HackerNoon at: https://hackernoon.com/data-driven-decisions-at-scale-ab-testing-best-practices-for-engineering-and-data-science-teams . Ship features like scientists: randomize, measure, and learn fast. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #big-data , #experimentation , #experimental-design , #product-development , #software-engineering , #machine-learning , #statistics , and more. This story was written by: @sayantan . Learn more about this writer by checking @sayantan's about page, and for more stories, please visit hackernoon.com . Ship features like scientists: randomize, measure, and learn fast. Good A/B tests aren’t just stats — they’re the engine driving smarter products.…

Data Science Tech Brief By HackerNoon

1
Why You Should (Almost) Always Choose Sync Gunicorn Workers 6:09

לפני 7 weeks6:09

6:09

This story was originally published on HackerNoon at: https://hackernoon.com/why-you-should-almost-always-choose-sync-gunicorn-over-workers-ze9c32wj . Anyone working on a WSGI web application frameworks like Flask would know that as a best practice it is very important to use a WSGI HTTP Server like Gunicorn to deploy the app outside your development servers. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #python-programming , #gevent , #gunicorn , #python-web-development , #flask , #flask-deployment , #latest-tech-stories , #what-are-gunicorn-worker-types , and more. This story was written by: @shamik-ray . Learn more about this writer by checking @shamik-ray's about page, and for more stories, please visit hackernoon.com . Gunicorn is a widely popular WSGI Server and its popularity is because it is lightweight, fast, simple yet can support most of the requirements you would have to host an app on production. The default worker type is Sync and I will be arguing for it. Async workers like Gevent create new greenlets (lightweight pseudo threads) Every time a new request comes they are handled by greenlets spawned by the worker threads. At the same time, the resources needed to serve the requests will be less.…

Data Science Tech Brief By HackerNoon

1
Beyond the Ten Blue Links: How Generative AI Rewires Our Brains for Search 7:26

לפני 7 weeks7:26

7:26

This story was originally published on HackerNoon at: https://hackernoon.com/beyond-the-ten-blue-links-how-generative-ai-rewires-our-brains-for-search . The age of searching is ending. A deep dive into the psychology of AI search, how it centralizes truth & why becoming a trusted source is key to brand survival Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #user-behavior-analytics , #ai-integrated-search , #digital-marketing , #seo , #geo , #future-tech , #psychology , #product-management , and more. This story was written by: @a_belova . Learn more about this writer by checking @a_belova's about page, and for more stories, please visit hackernoon.com . Generative AI isn't just a new feature in search; it's a fundamental psychological shift. By providing direct, synthesized answers, it caters to our brain's deep-seated desire to reduce cognitive load and trust authoritative narratives. This "great untraining" is rendering the classic marketing playbook obsolete. For businesses, developers, and marketers, the battle is no longer for clicks on blue links, but for becoming a trusted, citable source inside the AI's "brain." The age of persuasion is ending; the age of becoming a machine-readable source of truth has begun.…

Data Science Tech Brief By HackerNoon

1
Need Web Data? Here Are the 3 Methods Everyone’s Using 10:09

לפני 7 weeks10:09

10:09

This story was originally published on HackerNoon at: https://hackernoon.com/need-web-data-here-are-the-3-methods-everyones-using . Discover the three best, most modern methods to access and harness web data for your projects. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #web-data , #ai , #web-scraping , #sdk , #api , #mcp , #python , #good-company , and more. This story was written by: @brightdata . Learn more about this writer by checking @brightdata's about page, and for more stories, please visit hackernoon.com . Need web data? APIs, SDKs, and MCP provide flexible, scalable, and automated ways to access, scrape, and integrate web data for scripts, backends, web apps, pipelines, or AI agents.…

Data Science Tech Brief By HackerNoon

1
Applying Transitive Closure to Sort Products Into Categories, Considering Nesting and Overlaps 15:50

לפני 7 weeks15:50

15:50

This story was originally published on HackerNoon at: https://hackernoon.com/applying-transitive-closure-to-sort-products-into-categories-considering-nesting-and-overlaps . A guide to efficiently managing nested categories and overlapping products, ensuring fast retrieval without duplicates in e-commerce systems. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-management , #software-architecture , #product-categorization , #graph-theory , #microservices , #optimize-data-storage , #transitive-closure , #advanced-indexing , and more. This story was written by: @egorgrushin . Learn more about this writer by checking @egorgrushin's about page, and for more stories, please visit hackernoon.com . Handling product categorization in e-commerce can be quite the task, especially when nested categories and overlapping products make efficient retrieval without duplicates a real challenge. The method I found has a major impact on performance: setting up proper data storage, separating data for reading and modification, using relational and NoSQL databases, and applying graph theory to handle complex category nesting. The step-by-step guide shows how to sort out efficient data storage, use transitive closure for advanced indexing, build a service to maintain and update the graph, and take advantage of database indexing to avoid unnecessary sorting in RAM.…

Data Science Tech Brief By HackerNoon

1
98% of Data Strategies Fail: Let's Fix It 11:24

לפני 1 year11:24

11:24

This story was originally published on HackerNoon at: https://hackernoon.com/98percent-of-data-strategies-fail-lets-fix-it . Learn how to fix failing data strategies using the '5 W's' framework. Transform your approach to KPIs and drive real business value with actionable insights. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-strategy , #kpi-management , #business-intelligence , #data-driven-decisions , #executive-leadership , #analytics-roi , #data-roi , #data-governance , and more. This story was written by: @liorb . Learn more about this writer by checking @liorb's about page, and for more stories, please visit hackernoon.com . Even the most well-equipped organizations can find themselves serving up a mess instead of actionable insights. Here's a step-by-step process of fixing your data strategy, ensuring that you're serving up actionable data instead of a recipe for disaster. In the following sections, we'll dive into the common data strategy nightmares.…

Data Science Tech Brief By HackerNoon

1
How To Measure The Results Of In-App Events When Onelinks Don’t Work 5:59

לפני 1 year5:59

5:59

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-measure-the-results-of-in-app-events-when-onelinks-dont-work . How To Measure The Results Of In-App Events When Onelinks Don’t Work Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #analytics , #onelink , #inapp-events , #marketing , #app-store , #mobile-apps , #digital-marketing , #good-company , and more. This story was written by: @socialdiscoverygroup . Learn more about this writer by checking @socialdiscoverygroup's about page, and for more stories, please visit hackernoon.com . Many app developers and marketing managers face the challenge of accurately measuring the impact of In-App Events (IAEs) on the App Store. While IAEs have proven effective for re-engaging users, attracting new downloads, and increasing revenue, traditional tracking methods like OneLink don’t actually include IAEs. Major mobile attribution platforms confirm that currently there is no way to track IAEs properly. At Social Discovery Group, our portfolio of 60+ dating and entertainment brands is supported by a team of over 100 marketers dedicated to app growth and development. We’re used to measuring all our marketing efforts in terms of financial value. Eventually, we’ve managed to develop our own composite way to evaluate IAEs, and are going to share it with you.…

Data Science Tech Brief By HackerNoon

1
How AI-Powered Data Mapping is Democratizing Data Management 8:10

לפני 1 year8:10

8:10

This story was originally published on HackerNoon at: https://hackernoon.com/how-ai-powered-data-mapping-is-democratizing-data-management . Learn how AI-powered data mapping is transforming data management, making it more accessible and efficient for everyone. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-mapping , #data-management , #big-data , #ai-powered , #ai-powered-data-management , #democratizing-data-management , #data-science , #ai-powered-data-mapping , and more. This story was written by: @kristenburke . Learn more about this writer by checking @kristenburke's about page, and for more stories, please visit hackernoon.com . AI is revolutionizing data mapping by automating and simplifying the process, making data management more efficient and accessible for businesses and non-technical users alike.…

Data Science Tech Brief By HackerNoon

1
Data Engineering: What’s the Value of API Security in the Generative AI Era? 5:47

לפני 1 year5:47

5:47

This story was originally published on HackerNoon at: https://hackernoon.com/data-engineering-whats-the-value-of-api-security-in-the-generative-ai-era . Discover the importance of API security in the age of Generative AI. Learn how robust API protection ensures data integrity. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-engineering , #generative-ai , #ai-regulation , #api-security , #data-security , #data-privacy , #threat-detection , #cybersecurity-best-practices , and more. This story was written by: @karthikrajashekaran . Learn more about this writer by checking @karthikrajashekaran's about page, and for more stories, please visit hackernoon.com . API security is crucial in the era of Generative AI, ensuring data integrity, protecting user privacy, and enabling secure and efficient AI integration. Robust API protection helps prevent unauthorized access, data breaches, and potential misuse of AI capabilities.…

Data Science Tech Brief By HackerNoon

1
Say Goodbye to Outdated Diagrams: Automate Your Infrastructure Visualization 7:15

לפני 1 year7:15

7:15

This story was originally published on HackerNoon at: https://hackernoon.com/say-goodbye-to-outdated-diagrams-automate-your-infrastructure-visualization . Automate your infrastructure diagrams. Guide helps you maintain fresh, accurate visuals with minimal effort, perfect for managing Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #visualization , #cloud-infrastructure , #terraform , #diagram , #infrastructure-as-code , #cloud , #aws , #infrastructure-visualization , and more. This story was written by: @vladimirf . Learn more about this writer by checking @vladimirf's about page, and for more stories, please visit hackernoon.com . Tired of making awesome infrastructure diagrams that become outdated as soon as you save them? Yeah, me too. Luckily, there are tools out there to help.…

Data Science Tech Brief By HackerNoon

1
Why C-Suite Executives Won’t Cut it Without Data Skills Anymore 6:45

לפני 1 year6:45

6:45

This story was originally published on HackerNoon at: https://hackernoon.com/why-c-suite-executives-wont-cut-it-without-data-skills-anymore . Modern executives must master data skills to navigate data privacy, cybersecurity, and strategic decisions. Learn why C-suite leaders can't afford to lag behind Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-literacy , #thought-leadership , #leadership-skills , #data-skills , #data-governance , #data-visualization-tools , #cybersecurity-executives , #hackernoon-top-story , and more. This story was written by: @znenad079 . Learn more about this writer by checking @znenad079's about page, and for more stories, please visit hackernoon.com . Every industry generates massive amounts of data, which is now being used for better decision-making. One of today’s most pressing challenges for executives is data privacy concerns and cybersecurity. Modern executives must have data skills to understand the flow of valuable data in their company and know how to make it work for them.…

Data Science Tech Brief By HackerNoon

1
Meet New & Improved BigQuery: Single, Unified AI-Ready Data Platform 10:20

לפני 1 year10:20

10:20

This story was originally published on HackerNoon at: https://hackernoon.com/meet-new-and-improved-bigquery-single-unified-ai-ready-data-platform . Google has gone a step further and unified key data Google Cloud analytics capabilities under BigQuery - now the single, AI-ready data analytics platform. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analytics , #google-bigquery , #bigquery-and-google-cloud , #ai-integration , #big-query-and-gemini , #good-company , #hackernoon-top-story , #real-time-data-analytics , and more. This story was written by: @googlecloud . Learn more about this writer by checking @googlecloud's about page, and for more stories, please visit hackernoon.com . We’ve gone a step further and unified key data Google Cloud analytics capabilities under BigQuery, which is now the single, AI-ready data analytics platform. BigQuery incorporates key capabilities from multiple Google Cloud analytics services into a single product experience that offers the simplicity and scale you need to manage structured data in BigQuery tables, unstructured data like images, audience and documents, and streaming workloads, all with the best price-performance.…

Data Science Tech Brief By HackerNoon

1
Decoding Transformers' Superiority over RNNs in NLP Tasks 9:38

לפני 1 year9:38

9:38

This story was originally published on HackerNoon at: https://hackernoon.com/decoding-transformers-superiority-over-rnns-in-nlp-tasks . Explore the intriguing journey from Recurrent Neural Networks (RNNs) to Transformers in the world of Natural Language Processing in our latest piece: 'The Trans Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #nlp , #transformers , #llms , #natural-language-processing , #large-language-models , #rnn , #machine-learning , #neural-networks , and more. This story was written by: @artemborin . Learn more about this writer by checking @artemborin's about page, and for more stories, please visit hackernoon.com . Despite Recurrent Neural Networks (RNNs) designed to mirror certain aspects of human cognition, they've been surpassed by Transformers in Natural Language Processing tasks. The primary reasons include RNNs' issues with the vanishing gradient problem, difficulty in capturing long-range dependencies, and training inefficiencies. The hypothesis that larger RNNs could mitigate these issues falls short in practice due to computational inefficiencies and memory constraints. On the other hand, Transformers leverage their parallel processing ability and self-attention mechanism to efficiently handle sequences and train larger models. Thus, the evolution of AI architectures is driven not only by biological plausibility but also by practical considerations such as computational efficiency and scalability.…

Data Science Tech Brief By HackerNoon

1
How to Enable Auto-Start for Apache DolphinScheduler 4:18

לפני 1 year4:18

4:18

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-enable-auto-start-for-apache-dolphinscheduler . To set DolphinScheduler to start automatically upon system boot, you typically need to configure it as a system service. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #bigdata , #data-science , #workflow-automation , #linux , #how-to-enable-auto-start , #apache-dolphinscheduler , #apache-dolphinscheduler-guide , and more. This story was written by: @williamguo . Learn more about this writer by checking @williamguo's about page, and for more stories, please visit hackernoon.com . To set DolphinScheduler to start automatically upon system boot, you typically need to configure it as a system service. The following are general steps, which may vary depending on your operating system.…

Data Science Tech Brief By HackerNoon

1
Benchmarking Apache Kafka: Performance-per-price 13:11

לפני 1 year13:11

13:11

This story was originally published on HackerNoon at: https://hackernoon.com/benchmarking-apache-kafka-performance-per-price . This is a study comparing environments for Apache Kafka. The ultimate goal is to find the most effective setup and achieve the best price-performance ratio. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #apache-kafka , #amd , #arm , #aws , #gcp , #kafka-performance , #benchmarking-apache-kafka , #hackernoon-top-story , and more. This story was written by: @mishaepikhin . Learn more about this writer by checking @mishaepikhin's about page, and for more stories, please visit hackernoon.com . ARM rocks. Modern expensive architecture does not always mean “better”.…

Data Science Tech Brief By HackerNoon

1
When and When Not to Use Apache Kafka as a Database 9:26

לפני 1 year9:26

9:26

This story was originally published on HackerNoon at: https://hackernoon.com/when-and-when-not-to-use-apache-kafka-as-a-database . Discover how Apache Kafka’s data retention and querying capabilities make it similar to a database and learn when to use Kafka for database-like use cases. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #apache-kafka , #kafka-vs-database , #kafka-as-a-database , #real-time-data-processing , #database-management , #kafka-querying-capabilities , #open-source-event-streaming , #apache-kafka-for-data-storage , and more. This story was written by: @aahil . Learn more about this writer by checking @aahil's about page, and for more stories, please visit hackernoon.com . Apache Kafka, while not a traditional database, has database-like properties such as data retention and querying capabilities. This article explores when Kafka can be used for database-like purposes and when it is best suited as a streaming platform.…

Data Science Tech Brief By HackerNoon

1
A Leader's Guide to Data-Driven Success 7:35

לפני 1 year7:35

7:35

This story was originally published on HackerNoon at: https://hackernoon.com/a-leaders-guide-to-data-driven-success . Transform data from a source of frustration into a powerful business tool with this practical guide for executives. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-strategy , #business-insights , #data-management , #data-literacy , #data-analytics , #business-growth , #information-overload , #business-strategy , and more. This story was written by: @liorb . Learn more about this writer by checking @liorb's about page, and for more stories, please visit hackernoon.com . Despite having more information than ever, making informed decisions seems increasingly challenging. This guide is designed to help you transform data from a source of frustration into a powerful tool for driving business growth. From my own experience, I've seen professionals dedicating up to 50% of their workweek to validating data.…

Data Science Tech Brief By HackerNoon

1
Seamlessly Migrate Your On-Premise Data Pipeline to Azure with These Key Steps 12:35

לפני 1 year12:35

12:35

This story was originally published on HackerNoon at: https://hackernoon.com/seamlessly-migrate-your-on-premise-data-pipeline-to-azure-with-these-key-steps . Scaling AI/ML Data Needs: Migrating On-Premise Data Engineering Workloads to Azure Cloud Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-engineering , #azure-data-factory , #data-pipeline-migration , #azure-migration , #azure-data-integration , #cloud-data-transfer , #cloudera-to-azure , #azure-security-compliance , and more. This story was written by: @amlanpatnaik . Learn more about this writer by checking @amlanpatnaik's about page, and for more stories, please visit hackernoon.com . This guide details the process of migrating an on-premise Cloudera data system to Azure, covering key considerations, challenges, and best practices to ensure a smooth and secure transition.…

Data Science Tech Brief By HackerNoon

1
Data Collection for Product Managers 7:55

לפני 1 year7:55

7:55

This story was originally published on HackerNoon at: https://hackernoon.com/data-collection-for-product-managers . Discover how product managers can bridge the gap between intuition and data to optimize product improvement with best practices and real-world examples. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-collection , #startups , #data-product-management , #data-driven-insights , #data-driven-decision-making , #product-manager , #product-management-tips , #how-to-collect-data , and more. This story was written by: @carolinagarcia . Learn more about this writer by checking @carolinagarcia's about page, and for more stories, please visit hackernoon.com . Discover how product managers can bridge the gap between intuition and data to optimize product improvement. This guide explores the importance of data-driven decision-making, offering best practices and real-world examples from companies like NuBank, Monzo, Deliveroo, and Booking.com. Learn how to acquire insights from customer feedback, track performance metrics, monitor market trends, and refine product roadmaps through iterative experimentation. Become a data-driven PM and create products that users will love.…

Data Science Tech Brief By HackerNoon

1
Data Collection for Product Managers 7:55

לפני 1 year7:55

7:55

This story was originally published on HackerNoon at: https://hackernoon.com/data-collection-for-product-managers . Discover how product managers can bridge the gap between intuition and data to optimize product improvement with best practices and real-world examples. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-collection , #startups , #data-product-management , #data-driven-insights , #data-driven-decision-making , #product-manager , #product-management-tips , #how-to-collect-data , and more. This story was written by: @carolinagarcia . Learn more about this writer by checking @carolinagarcia's about page, and for more stories, please visit hackernoon.com . Discover how product managers can bridge the gap between intuition and data to optimize product improvement. This guide explores the importance of data-driven decision-making, offering best practices and real-world examples from companies like NuBank, Monzo, Deliveroo, and Booking.com. Learn how to acquire insights from customer feedback, track performance metrics, monitor market trends, and refine product roadmaps through iterative experimentation. Become a data-driven PM and create products that users will love.…

Data Science Tech Brief By HackerNoon

1
Leveraging Data Granularity, Distribution, and Modeling for Effective Product Management 11:39

לפני 1 year11:39

11:39

This story was originally published on HackerNoon at: https://hackernoon.com/leveraging-data-granularity-distribution-and-modeling-for-effective-product-management . These three fundamental concepts are exceptionally needed for being able to use data to enhance product strategy. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analysis , #data-driven-product-management , #data-granularity , #data-distribution , #product-strategy , #user-behavior-analysis , #data-modeling , #business-strategy , and more. This story was written by: @gevorgkazaryan . Learn more about this writer by checking @gevorgkazaryan's about page, and for more stories, please visit hackernoon.com . Granularity determines the level of detail available in the data, which directly impacts what you can observe and analyze. For instance, finer granularity provides more detailed insights but may require more sophisticated handling and processing techniques. Distribution helps identify the patterns and spread of data, which is critical for selecting the appropriate analysis techniques and ensuring the accuracy of predictive models. Data Modeling uses the insights gained from understanding granularity and distribution to build predictive or descriptive models that inform decision-making and strategy.…

Data Science Tech Brief By HackerNoon

1
How Vectors, Rag and Llama 3 Are Changing First-Party Data 7:59

לפני 1 year7:59

7:59

This story was originally published on HackerNoon at: https://hackernoon.com/how-vectors-rag-and-llama-3-are-changing-first-party-data . In the battle for the best data, is first-party better? Not by itself, but it could be with vectors, frameworks like RAG, and open-source models Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #first-party-data , #big-data , #datasets , #rag-architecture , #retrieval-augmented-generation , #vector-embedding , #ai-models-for-data-analysis , #hackernoon-top-story , and more. This story was written by: @danielsvonava . Learn more about this writer by checking @danielsvonava's about page, and for more stories, please visit hackernoon.com . The push for first-party data generally goes that companies need to become better stewards of data acquisition and management. Consumers increasingly want to know who is hanging onto their personal information, how they got it, why they have it, and what is being done with it. The push to take back control of data seems essential, but is it practical?…

Data Science Tech Brief By HackerNoon

1
16 Best Sklearn Datasets for Building Machine Learning Models 21:22

לפני 1 year21:22

21:22

This story was originally published on HackerNoon at: https://hackernoon.com/16-best-sklearn-datasets-for-building-machine-learning-models . Sklearn datasets are included as part of the scikit-learn (sklearn) library, so they come pre-installed with the library. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #sklearn , #datasets , #datascience , #sklearn-datasets , #machine-learning , #python-programming , #dataset , #hackernoon-top-story , and more. This story was written by: @datasets . Learn more about this writer by checking @datasets's about page, and for more stories, please visit hackernoon.com . Sklearn is a Python module for machine learning built on top of SciPy. It is unique due to its wide range of algorithms and ease of use. Data powers machine learning algorithms and scikit-learn. Sklearn offers high quality datasets that are widely used by researchers, practitioners and enthusiasts.…

Data Science Tech Brief By HackerNoon

1
Enhancing Audit Processes With Advanced Analytical Tools 5:01

לפני 1 year5:01

5:01

This story was originally published on HackerNoon at: https://hackernoon.com/enhancing-audit-processes-with-advanced-analytical-tools . Discover how advanced analytical tools streamline audit processes, boosting accuracy and efficiency for tech professionals. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #advanced-analytics , #software-development , #audit , #analytics-based-auditing , #auditing-tech , #data-visualization , #complex-event-processing , #ai-in-analytics , and more. This story was written by: @devinpartida . Learn more about this writer by checking @devinpartida's about page, and for more stories, please visit hackernoon.com . Developers can leverage advanced analytics tools to streamline and improve software, compliance and internal controls auditing. Advanced analytics tools like artificial intelligence, complex event processing and data mining enable 100% population testing. They eliminate the need for sampling, thereby reducing bias and error risks. Autonomous technologies like AI are particularly beneficial since they eliminate human error.…

Data Science Tech Brief By HackerNoon

1
Go Clean to Be Lean: Data Optimization for Improved Business Efficiency 11:30

לפני 1 year11:30

11:30

This story was originally published on HackerNoon at: https://hackernoon.com/go-clean-to-be-lean-data-optimization-for-improved-business-efficiency . The article discusses cost optimization with clean data, explaining how businesses can save resources by reducing the workload for data analysts and more. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-cleaning , #data-optimization , #data-cleansing , #clean-data , #big-data , #big-data-processing , #data-processing , #business-data , and more. This story was written by: @karolisdidziulis . Learn more about this writer by checking @karolisdidziulis's about page, and for more stories, please visit hackernoon.com . This article discusses cost optimization with clean data. It explains how businesses can save resources by decreasing the load for data analysts, among other opportunities. It also discusses the differences between raw and clean data and who can benefit from switching to the latter. You'll also find 4 ways in which clean data reduces time to value.…

Data Science Tech Brief By HackerNoon

1
Efficient Data Management and Workflow Orchestration with Apache Doris Job Scheduler 7:26

לפני 1 year7:26

7:26

This story was originally published on HackerNoon at: https://hackernoon.com/efficient-data-management-and-workflow-orchestration-with-apache-doris-job-scheduler . Apache Doris 2.1.0's built-in Job Scheduler simplifies task automation with high efficiency, flexibility, and easy integration for seamless data management. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-engineering , #big-data , #database , #open-source , #programming , #apache-doris , #task-automation , #workflow-orchestration , and more. This story was written by: @frankzzz . Learn more about this writer by checking @frankzzz's about page, and for more stories, please visit hackernoon.com . The built-in Doris Job Scheduler triggers pre-defined operations efficiently and reliably. It is useful in many cases including ETL and data lake analytics.…

Data Science Tech Brief By HackerNoon

1
Scaling Ethereum: Data Bloat, Data Availability, and the Cloudless Solution 17:12

לפני 1 year17:12

17:12

This story was originally published on HackerNoon at: https://hackernoon.com/scaling-ethereum-data-bloat-data-availability-and-the-cloudless-solution . Determining how to persist Ethereum’s excess data will allow it to scale indefinitely into the future, and Codex has arrived to help. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-storage , #decentralized-storage , #peer-to-peer , #web3-storage , #ethereum , #ethereum-scaling , #good-company , #data-bloat , and more. This story was written by: @logos . Learn more about this writer by checking @logos's about page, and for more stories, please visit hackernoon.com . Codex is a cloudless, trustless, p2p storage protocol seeking to offer strong data persistence and durability guarantees for the Ethereum ecosystem and beyond. Due to the rapid development and implementation of new protocols, the Ethereum blockchain chain has become bloated with data. This data bloat can also be defined as “network congestion,” where transaction data clogs the network and undermines scalability. Codex offers a solution to the DA problem, except with data persistence.…

Data Science Tech Brief By HackerNoon

1
What Frontend Devs Want (From Backend Devs) 5:42

לפני 1 year5:42

5:42

This story was originally published on HackerNoon at: https://hackernoon.com/what-frontend-devs-want-from-backend-devs . Backend developers can help frontend developers work with their API more efficiently and ship the product with as little friction as possible. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-structure , #backend-developer , #typescript , #programming-advice , #api , #coding-teamwork , #how-to-have-clean-code , #figma , and more. This story was written by: @smileek . Learn more about this writer by checking @smileek's about page, and for more stories, please visit hackernoon.com . Backend developers can help frontend developers work with their API more efficiently and ship the product with as little friction as possible. Here are a few simple things that can decrease your time-to-market or improve other fancy metrics your managers want you to improve. I will tell it from the web developers’ point of view, but from what I remember, the same works for mobile development.…

Data Science Tech Brief By HackerNoon

1
How to Build an AI Chatbot with Python and Gemini API 6:04

לפני 1 year6:04

6:04

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-build-an-ai-chatbot-with-python-and-gemini-api . Learn how to create a web-based AI chatbot using Python and the Gemini API with this step-by-step beginner-friendly guide. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #python-programming , #ai-chatbot , #google-gemini , #google-ai , #gemini-api , #python-tutorials , #python-flask , #chatbot-development , and more. This story was written by: @proflead . Learn more about this writer by checking @proflead's about page, and for more stories, please visit hackernoon.com . This guide walks you through building a web-based AI chatbot using Python and the Gemini API. From setting up your environment to running your chatbot, you'll learn each step to create your own AI assistant.…

Data Science Tech Brief By HackerNoon

1
How to Set Up a Local DNS Server With Python 4:13

לפני 1 year4:13

4:13

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-set-up-a-local-dns-server-with-python . DNS servers play a crucial role in translating human-friendly domain names into IP addresses that computers use to identify each other on the network. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #python-programming , #networking , #dns-server-guide , #how-to-set-up-dns-server , #how-to-creatw-html-files , #http-server-guide , #troubleshooting-dns-server , #python-and-dns-servers , and more. This story was written by: @hackerclukchp0j00003b6oy80p1nrw . Learn more about this writer by checking @hackerclukchp0j00003b6oy80p1nrw's about page, and for more stories, please visit hackernoon.com . DNS servers play a crucial role in translating human-friendly domain names into IP addresses that computers use to identify each other on the network. Setting up your own local DNS server can be beneficial for various reasons, including local development, internal network management, and educational purposes. We’ll create a simple HTTP server using Python’s built-in `http.server` module to serve the HTML files.…

Data Science Tech Brief By HackerNoon

1
The Collective Loves Data: How Big Data Is Shaping and Predicting Our Future 8:11

לפני 1 year8:11

8:11

This story was originally published on HackerNoon at: https://hackernoon.com/the-collective-loves-data-how-big-data-is-shaping-and-predicting-our-future . Big data shapes our future! Explore how massive datasets are used to predict trends & make smarter decisions. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #big-data , #what-is-big-data , #examples-of-big-data , #digital-footprint , #machine-world , #big-data-storage , #big-data-processing , #what-to-know-about-big-data , and more. This story was written by: @manoj123 . Learn more about this writer by checking @manoj123's about page, and for more stories, please visit hackernoon.com . Big data surrounds us! From social media posts to sensor readings, vast amounts of information shape our world. This article by a Google engineer dives into what big data is (think massive, varied, and ever-growing data sets) and how it's analyzed to predict trends and make smarter decisions. Learn about real-world applications and exciting future possibilities like AI and quantum computing.…

Data Science Tech Brief By HackerNoon

1
Apache Doris for Log and Time Series Data Analysis in NetEase: Why Not Elasticsearch and InfluxDB? 12:01

לפני 1 year12:01

12:01

This story was originally published on HackerNoon at: https://hackernoon.com/apache-doris-for-log-and-time-series-data-analysis-in-netease-why-not-elasticsearch-and-influxdb . NetEase has replaced Elasticsearch and InfluxDB with Apache Doris in its monitoring and time series data analysis platforms, respectively Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-engineering , #logging , #time-series-analysis , #time-series-database , #big-data-analytics , #elasticsearch , #database , #netease , and more. This story was written by: @frankzzz . Learn more about this writer by checking @frankzzz's about page, and for more stories, please visit hackernoon.com . NetEase has replaced Elasticsearch and InfluxDB with Apache Doris in its monitoring and time series data analysis platforms, respectively, achieving 11X query performance and saving 70% of resources.…

Data Science Tech Brief By HackerNoon

1
Unlocking the Power of Data Lakes for Embedded Analytics in Multi-Tenant SaaS 15:16

לפני 1 year15:16

15:16

This story was originally published on HackerNoon at: https://hackernoon.com/unlocking-the-power-of-data-lakes-for-embedded-analytics-in-multi-tenant-saas . Discover why data lakes are superior to traditional data warehouses for embedded analytics in SaaS applications. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analytics , #embedded-analytics , #data-lake , #data-warehouse , #qrvey , #b2b-saas , #data-storage , #good-company , and more. This story was written by: @goqrvey . Learn more about this writer by checking @goqrvey's about page, and for more stories, please visit hackernoon.com . Analytics should extract maximum insight right? Well, to do that, you’ll need complete access to all relevant data. A data lake is a central storage for all kinds of data in its original, unstructured form. Data lakes are generally more cost-effective than data warehouses for embedded analytics use cases.…

Data Science Tech Brief By HackerNoon

1
The LinkedIn Nanotargeting Experiment that Broke All the Rules 10:50

לפני 1 year10:50

10:50

This story was originally published on HackerNoon at: https://hackernoon.com/the-linkedin-nanotargeting-experiment-that-broke-all-the-rules . Discover how a groundbreaking nanotargeting experiment on LinkedIn defies audience size restrictions, unlocking new ad campaign strategies. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #nanotargeting , #online-advertising , #user-privacy , #user-data-security , #hyper-personalized-ads , #public-data-risks , #linkedin-advertising , #hackernoon-top-story , and more. This story was written by: @netizenship . Learn more about this writer by checking @netizenship's about page, and for more stories, please visit hackernoon.com . A study demonstrates the feasibility of nanotargeting on LinkedIn, bypassing audience size restrictions and achieving successful campaigns by employing JavaScript code to reactivate campaign launch buttons, employing various targeting strategies, and verifying success through campaign metrics and user interaction.…

Data Science Tech Brief By HackerNoon

1
Data Science Interview Question: Creating ROC & Precision Recall Curves From Scratch 8:59

לפני 1 year8:59

8:59

This story was originally published on HackerNoon at: https://hackernoon.com/data-science-interview-question-creating-roc-and-precision-recall-curves-from-scratch . This is one of the popular data science interview questions which requires one to create the ROC and similar curves from scratch. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #data-science-interview , #precision-and-recall , #precision-recall-curves , #roc-data-science , #data-analysis , #data-science-job-questions , #hackernoon-top-story , and more. This story was written by: @varunnakra1 . Learn more about this writer by checking @varunnakra1's about page, and for more stories, please visit hackernoon.com . This is one of the popular data science interview questions which requires one to create the ROC and similar curves from scratch. For the purposes of this story, I will assume that readers are aware of the meaning and the calculations behind these metrics and what they represent and how are they interpreted. We start with importing the necessary libraries (we import math as well because that module is used in calculations)…

Data Science Tech Brief By HackerNoon

1
Why Should Companies Outsource Data Processing? 6:05

לפני 1 year6:05

6:05

This story was originally published on HackerNoon at: https://hackernoon.com/why-should-companies-outsource-data-processing . Data processing outsourcing boosts efficiency, reduces costs, and enhances decision-making, helping businesses manage and leverage vast data effectively. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data , #data-processing , #data-outsourcing , #data-mangagement , #data-security , #data-cost-reduction , #data-efficiency , #data-science , and more. This story was written by: @rayanpotterr . Learn more about this writer by checking @rayanpotterr's about page, and for more stories, please visit hackernoon.com . Data processing is an essential business process and it consists of activities like order processing, form processing, compilation of mailing lists, and processing of different organizational and business information. Data processing outsourcing also offers a two-fold benefit i.e. low operational expenses and increased operational efficiency. It also helps in enhancing data quality, obtaining insights quicker to make well-informed and timely business decisions.…

Data Science Tech Brief By HackerNoon

1
The Role of Big Data in Developing New Medicines 6:30

לפני 1 year6:30

6:30

This story was originally published on HackerNoon at: https://hackernoon.com/the-role-of-big-data-in-developing-new-medicines . Drug development is one of the most crucial — and time-consuming — processes in medicine. Here's how big data can help. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #big-data , #drug-discovery , #medicine , #drug-development , #artificial-intelligence , #healthcare , #pharmaceutical , #hackernoon-top-story , and more. This story was written by: @zacamos . Learn more about this writer by checking @zacamos's about page, and for more stories, please visit hackernoon.com . Developing a new medicine takes an average of 12 years, but big data can improve every stage of the process. It helps fuel AI drug discovery, identify underserved needs, streamline clinical trials, and monitor for potential issues.…

Data Science Tech Brief By HackerNoon

1
Building CI Pipeline with Databricks Asset Bundle and GitLab 10:59

לפני 1 year10:59

10:59

This story was originally published on HackerNoon at: https://hackernoon.com/building-ci-pipeline-with-databricks-asset-bundle-and-gitlab . Databricks Asset Bundle streamlines the development of complex data, analytics, and ML projects for the Databricks platform. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #databricks , #gitlab , #devops , #mlops-platforms , #databricks-asset-bundles , #databricks-gui , #how-to-build-a-ci-pipeline , #hackernoon-top-story , and more. This story was written by: @neshom . Learn more about this writer by checking @neshom's about page, and for more stories, please visit hackernoon.com . In the previous blog, I showed you how to build a CI pipeline using Databricks CLI eXtensions and GitLab. In this post, I will show you how to achieve the same objective with the latest and recommended Databricks deployment framework, Databricks Asset Bundles.…

Data Science Tech Brief By HackerNoon

1
How I'm Building an AI for Analytics Service 7:12

לפני 1 year7:12

7:12

This story was originally published on HackerNoon at: https://hackernoon.com/how-im-building-an-ai-for-analytics-service . In this article I want to share my experience with developing an AI service for a web analytics platform called Swetrix. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analysis , #ai , #analytics , #website-traffic , #software-architecture , #machine-learning , #predictive-analytics , #hackernoon-top-story , and more. This story was written by: @pro1code1hack . Learn more about this writer by checking @pro1code1hack's about page, and for more stories, please visit hackernoon.com . In this article I want to share my experience with developing an AI service for a web analytics platform, called Swetrix. My aim was to develop a machine learning model that would predict future website traffic based on the data displayed on the following screenshot. The end goal is to have a clear vision for the customer of what traffic will appear on their website in the future.…

Data Science Tech Brief By HackerNoon

1
Real-Time Anomaly Detection in Underwater Gliders: Experimental Evaluation 10:13

לפני 1 year10:13

10:13

This story was originally published on HackerNoon at: https://hackernoon.com/real-time-anomaly-detection-in-underwater-gliders-experimental-evaluation . This paper presents a real-time anomaly detection algorithm to enhance underwater glider safety using datasets from actual deployments. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analysis , #machine-learning , #underwater-gliders , #anomaly-detection , #oceanography , #glider-navigation , #ocean-data , #marine-robotics , and more. This story was written by: @oceanography . Learn more about this writer by checking @oceanography's about page, and for more stories, please visit hackernoon.com . We apply the anomaly detection algorithm to four glider deployments across the coastal ocean of Florida and Georgia, USA. For evaluation, the anomaly detected by the algorithm is cross-validated by high-resolution glider DBD data and pilot notes. We simulate the online detection process on SBD and compare the result with that detected from DBD.…

Data Science Tech Brief By HackerNoon

1
Real-Time Anomaly Detection in Underwater Gliders: Abstract and Intro 7:22

לפני 1 year7:22

7:22

This story was originally published on HackerNoon at: https://hackernoon.com/real-time-anomaly-detection-in-underwater-gliders-abstract-and-intro . This paper presents a real-time anomaly detection algorithm to enhance underwater glider safety, using datasets from actual deployments. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analysis , #machine-learning , #underwater-gliders , #anomaly-detection , #oceanography , #glider-navigation , #ocean-data , #marine-robotics , and more. This story was written by: @oceanography . Learn more about this writer by checking @oceanography's about page, and for more stories, please visit hackernoon.com . Underwater gliders are widely used in oceanography for a range of applications. However, unpredictable events like shark strikes or remora attachments can lead to abnormal glider behavior or even loss of the instrument. This paper employs an anomaly detection algorithm to assess operational conditions of underwater gliders in the real-world ocean environment. Prompt alerts are provided to glider pilots upon detecting any anomaly.…

Data Science Tech Brief By HackerNoon

1
The Power of Universal Semantic Layers: Insights from Cube Co-founder Artyom Keydunov 9:37

לפני 1 year9:37

9:37

This story was originally published on HackerNoon at: https://hackernoon.com/the-power-of-universal-semantic-layers-insights-from-cube-co-founder-artyom-keydunov . What is a universal semantic layer, and how is it different from a semantic layer? Is there actual semantics involved? Who uses that, how, and what for? Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #analytics , #business-intelligence , #data-modeling , #data-integration , #knowledge-graph , #universal-semantic-layer , #data-visualization , #data-warehouses , and more. This story was written by: @linked_do . Learn more about this writer by checking @linked_do's about page, and for more stories, please visit hackernoon.com . What is a universal semantic layer, and how is it different from a semantic layer? Is there actual semantics involved? Who uses that, how, and what for?…

Data Science Tech Brief By HackerNoon

1
A Comprehensive Guide to Building DolphinScheduler 3.2.0 Production-Grade Cluster Deployment 9:04

לפני 1 year9:04

9:04

This story was originally published on HackerNoon at: https://hackernoon.com/a-comprehensive-guide-to-building-dolphinscheduler-320-production-grade-cluster-deployment . In version 3.2.0, DolphinScheduler introduces a series of new features and improvements, significantly enhancing its stability. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #workflow-management , #opensource , #programming , #dolphinscheduler , #apache-dolphinscheduler , #big-data , #cluster-deployment , and more. This story was written by: @zhoujieguang . Learn more about this writer by checking @zhoujieguang's about page, and for more stories, please visit hackernoon.com . DolphinScheduler provides powerful workflow management and scheduling capabilities for data engineers by simplifying complex task dependencies. In version 3.2.0, DolphinScheduler introduces a series of new features and improvements, significantly enhancing its stability and availability in production environments.…

Data Science Tech Brief By HackerNoon

1
Why Monitoring a Distributed Database is More Complex Than You Might Expect 20:18

לפני 1 year20:18

20:18

This story was originally published on HackerNoon at: https://hackernoon.com/why-monitoring-a-distributed-database-more-complex-than-you-might-expect . Why is monitoring a distributed database more complex than you might expect Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #distributed-databases , #opentelemetry , #monitor-distributed-databases , #apache-ignite , #monitoring-systems , #database-monitoring-challenges , #data-acquisition-models , #push-vs-pull-acquisition , and more. This story was written by: @ingvard . Learn more about this writer by checking @ingvard's about page, and for more stories, please visit hackernoon.com . In this article, we will dive into the complexities of monitoring distributed databases from the perspective of a monitoring system developer. I will try to cover the following topics: managing multiple nodes, network restrictions, and issues related to high throughput caused by a large number of metrics.…

Data Science Tech Brief By HackerNoon

1
Outlier Detection: What You Need to Know 2:43

לפני 1 year2:43

2:43

This story was originally published on HackerNoon at: https://hackernoon.com/outlier-detection-what-you-need-to-know . Decisions are usually based on the sample mean, which is very sensitive to outliers and can dramatically change the value. So, it is crucial to manage outliers Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #outlier-detection , #statistics , #python3 , #variance-reducing , #what-is-outlier-detection , #bootstrap , #problem-formulation , #data-analysis , and more. This story was written by: @nataliaogneva . Learn more about this writer by checking @nataliaogneva's about page, and for more stories, please visit hackernoon.com . Analysts often encounter outliers in data during their work. Decisions are usually based on the sample mean, which is very sensitive to outliers. It is crucial to manage outliers to make the correct decision. Let's consider several simple and fast approaches for working with unusual values.…

Data Science Tech Brief By HackerNoon

1
Instrument Variables and AB Testing – Part 1 1:28

לפני 1 year1:28

1:28

This story was originally published on HackerNoon at: https://hackernoon.com/instrument-variables-and-ab-testing-part-1 . This article explores the Mathematical details of least squares estimator in an unbiased and biased settings due to model specification errors. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #linear-regression , #ab-testing , #casual-analysis , #bias , #multicollinearity , #confounding , #instrument-variables , #instrument-variables-math , and more. This story was written by: @varunnakra1 . Learn more about this writer by checking @varunnakra1's about page, and for more stories, please visit hackernoon.com . This article explores the Mathematical details of least squares estimator in an unbiased and biased settings due to model specification errors.…

Data Science Tech Brief By HackerNoon

1
Using Arrow Flight SQL Protocol in Apache Doris 2.1 For Super Fast Data Transfer 8:00

לפני 1 year8:00

8:00

This story was originally published on HackerNoon at: https://hackernoon.com/using-arrow-flight-sql-protocol-in-apache-doris-21-for-super-fast-data-transfer . Apache Doris 2.1 just got a major speed boost with Arrow Flight SQL for up to 10x faster data transfers. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #database , #data-engineering , #pandas , #python , #apache-arrow , #big-data , #data , and more. This story was written by: @frankzzz . Learn more about this writer by checking @frankzzz's about page, and for more stories, please visit hackernoon.com . Apache Doris 2.1 supports Arrow Flight SQL protocol for reading data from Doris. It delivers tens-fold speedups compared to PyMySQL and Pandas.…

Data Science Tech Brief By HackerNoon

1
Data Science for Portfolio Optimization: Markowitz Mean-Variance Theory 5:47

לפני 2 years5:47

5:47

This story was originally published on HackerNoon at: https://hackernoon.com/data-science-for-portfolio-optimization-markowitz-mean-variance-theory . The theory formulates a mathematical model to optimize the asset allocations to gain the maximum return for a given risk-level. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #asset-management , #modern-portfolio-theory , #portfolio-optimization , #markowtiz-mean-variance , #what-is-the-markowitz-theory , #portfolio-theory , #investment-portfolio-tips , and more. This story was written by: @kustarev . Learn more about this writer by checking @kustarev's about page, and for more stories, please visit hackernoon.com . An investment portfolio comprises various assets such as stocks and bonds. Every investor starts with a fixed investment capital and decides how much to invest in each asset. Data science techniques such as the Markowitz mean-variance theory help determine the optimal share allocation to build the optimal portfolio. The theory formulates a mathematical model to optimize the asset allocations to gain the maximum return for a given risk-level. It analyzes different financial assets and considers their rate of return and risk factors, given their historical trends. The rate of return is an approximation of how much profit the asset will generate over a given time period. The risk factor is quantified using the standard deviation of the asset value. A higher deviation represents a volatile asset and, hence, higher risk. The return and risk values are calculated for various portfolio combinations and are represented on the efficient frontier curve. The curve helps investors determine the highest returns against their selected risk.…

Data Science Tech Brief By HackerNoon

1
10 Best Datasets for Time Series Analysis 8:23

לפני 2 years8:23

8:23

This story was originally published on HackerNoon at: https://hackernoon.com/10-best-datasets-for-time-series-analysis . In order to understand how a certain metric varies over time and to predict future values, we will look at the 10 Best Datasets for Time Series Analysis. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #datasets , #ai , #data-science , #data-analysis , #data-analytics , #data-visualization , #hackernoon-datasets , #machine-learning , and more. This story was written by: @datasets . Learn more about this writer by checking @datasets's about page, and for more stories, please visit hackernoon.com . Time series data is essentially a collection of data points organized in time. Time is frequently the independent variable, and the purpose is usually to forecast the future in time series. In this article, we will look at the *10 Best Datasets for Time Series Analysis,* in order to understand how a certain metric varies over time.…

Data Science Tech Brief By HackerNoon

1
Understanding Scaling Law through Data Science Lenses 14:29

לפני 2 years14:29

14:29

This story was originally published on HackerNoon at: https://hackernoon.com/understanding-scaling-law-through-data-science-lenses . Despite the immense promise of LMs, initial endeavors to apply pre-trained LMs to downstream tasks have encountered significant challenges. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #scaling-law , #artificial-intelligence , #tokenizing-raw-text , #discrete-tokens , #embedding-vector , #token-embeddings , #power-laws , and more. This story was written by: @tianchengxu . Learn more about this writer by checking @tianchengxu's about page, and for more stories, please visit hackernoon.com . Despite the immense promise of LMs as task-neutral foundation models, initial endeavors to apply pre-trained LMs to downstream tasks encountered significant challenges.…

Data Science Tech Brief By HackerNoon

1
Why PostgreSQL Is the Bedrock for the Future of Data 23:06

לפני 2 years23:06

23:06

This story was originally published on HackerNoon at: https://hackernoon.com/why-postgresql-is-the-bedrock-for-the-future-of-data . Explore the rise of PostgreSQL as the de facto database standard, its impact on software development, and the key trends driving its widespread adoption. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-management , #postgresql , #timescale , #future-of-data-science , #software-development , #database-complexity , #timescaledb , #good-company , #hackernoon-es , #hackernoon-hi , #hackernoon-zh , #hackernoon-fr , #hackernoon-bn , #hackernoon-ru , #hackernoon-vi , #hackernoon-pt , #hackernoon-ja , #hackernoon-de , #hackernoon-ko , #hackernoon-tr , and more. This story was written by: @timescale . Learn more about this writer by checking @timescale's about page, and for more stories, please visit hackernoon.com . PostgreSQL's ascendancy as the go-to database standard is rooted in its adaptability, reliability, and extensive ecosystem. This article delves into the reasons behind its dominance, from tackling database complexity to empowering developers to build the future with confidence. Discover how PostgreSQL is revolutionizing software development and data management practices.…

Data Science Tech Brief By HackerNoon

1
How to Implement Multi-Group Bar Chart and Interact With Highlighting by Grouping Dimension 1:21

לפני 2 years1:21

1:21

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-implement-multi-group-bar-chart-and-interact-with-highlighting-by-grouping-dimension . Solution for implementing a multi-group bar chart similar to the following figure: Expect two groups to differentiate in style through color transparency. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #visualization , #visactor , #vchart , #multi-group-bar-chart , #grouping-dimensions , #data-science-guide , #vchart-guide , #vchart-tutorial , and more. This story was written by: @hacker5022841 . Learn more about this writer by checking @hacker5022841's about page, and for more stories, please visit hackernoon.com . Solution for implementing a multi-group bar chart similar to the following figure: Expect two groups to differentiate in style through color transparency. When the mouse hovers over a column block, all blocks of the same color are highlighted in linkage.…

Data Science Tech Brief By HackerNoon

1
Unlocking the Invaluable Role of Big Data in Modern Supply Chain Management 7:55

לפני 2 years7:55

7:55

This story was originally published on HackerNoon at: https://hackernoon.com/unlocking-the-invaluable-role-of-big-data-in-modern-supply-chain-management . Let’s take a deeper look at the scale of impact the big data revolution can have for global supply chains and vendor management. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #big-data , #supply-chain , #big-data-analytics , #management , #supply-chain-ai , #supply-chain-management , #data-revolution , #supply-chain-efficiency , and more. This story was written by: @dmytrospilka . Learn more about this writer by checking @dmytrospilka's about page, and for more stories, please visit hackernoon.com . Let’s take a deeper look at the scale of impact the big data revolution can have for global supply chains and vendor management.…

Data Science Tech Brief By HackerNoon

1
Advantages and Disadvantages of Big Data 5:55

לפני 2 years5:55

5:55

This story was originally published on HackerNoon at: https://hackernoon.com/advantages-and-disadvantages-of-big-data . Big data may seem like any other buzzword in business, but it’s important to understand how big data benefits a company and how it’s limited. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #big-data , #data-science , #data-analysis , #data-analytics , #big-data-analytics , #advantages-of-big-data , #disadvantages-of-big-data , and more. This story was written by: @devinpartida . Learn more about this writer by checking @devinpartida's about page, and for more stories, please visit hackernoon.com . Big data may seem like any other buzzword in business. Still, it’s important to understand how big data benefits a company and how it’s limited. If a company uses big data to its advantage, it can be a major boon for them and help them outperform its competitors. Advantages include improved decision making, reduced costs, increased productivity and enhanced customer service. Disadvantages include cybersecurity risks, talent gaps and compliance complications.…

Data Science Tech Brief By HackerNoon

1
The Top 16 Types of Charts in Data Visualization That You'll Use 9:07

לפני 2 years9:07

9:07

This story was originally published on HackerNoon at: https://hackernoon.com/top-16-types-of-chart-in-data-visualization-hrh32wv . In the era of information explosion, more and more data piles up. However, these dense data are unfocused and less readable. So we need data visualization to help data to be easily understood and accepted. By contrast, visualization is more intuitive and meaningful, and it is very important to use appropriate charts to visualize data. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-visualization , #big-data , #latest-tech-stories , #hackernoon-top-story , #data-representation , #how-to-visualize-data , #column-chart-vs-bar-chart , #area-chart-vs-pie-chart , #hackernoon-es , and more. This story was written by: @sage . Learn more about this writer by checking @sage's about page, and for more stories, please visit hackernoon.com . The Top 16 Types of Charts in Data Visualization That You'll Use: Column Chart, Bar Chart, Scatter Plot, Bubble Chart, Radar Chart and Bubble Chart. All the charts in the article are taken from the data visualization tool FineReport. The chart is used to show the change of data over a continuous time interval or time span. It is characterized by a tendency to reflect things as they change over time or ordered categories. It should be noted that the number of data records of the line graph should be greater than 2.…

Data Science Tech Brief By HackerNoon

1
Data in AI: A Deep Dive With Jerome Pasquero 2:25

לפני 2 years2:25

2:25

This story was originally published on HackerNoon at: https://hackernoon.com/data-in-ai-a-deep-dive-with-jerome-pasquero . How is Data Transforming AI - The What's AI Podcast (episode 27) Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data , #big-data , #data-security , #ai , #artificial-intelligence , #machine-learning , #jerome-pasquero , #what's-ai , and more. This story was written by: @whatsai . Learn more about this writer by checking @whatsai's about page, and for more stories, please visit hackernoon.com . This week's episode of the What's AI podcast features Machine Learning Director Jerome Pasquero. We discussed the role of human judgment in data annotation. We also touched on the often subtle yet significant presence of AI in our daily routines. This episode is a must for anyone curious about the ways in which data fuels AI.…

Data Science Tech Brief By HackerNoon

1
14 Best Tableau Datasets for Practicing Data Visualization 18:12

לפני 2 years18:12

18:12

This story was originally published on HackerNoon at: https://hackernoon.com/14-best-tableau-datasets-for-practicing-data-visualization . This article focuses on the 14 Best Tableau Datasets for Practicing Data Visualization, which is essential for business analysts and data scientists. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #tableau , #data , #datasets , #covid-19-datasets , #data-visualization , #data-visualization-tools , #data-analysis , #tableau-vs-powerbi , and more. This story was written by: @datasets . Learn more about this writer by checking @datasets's about page, and for more stories, please visit hackernoon.com . Tableau is a data analysis and visualization tool that enables users to connect, visualize and share data in an easy-to-understand and meaningful way. This article focuses on the 14 Best Tableau Datasets for Practicing Data Visualization, essential for helping you gain valuable experience.…

Data Science Tech Brief By HackerNoon

1
The Lifecycle of a Data Warehouse 8:48

לפני 2 years8:48

8:48

This story was originally published on HackerNoon at: https://hackernoon.com/the-lifecycle-of-a-data-warehouse . We're about to embark on the fascinating journey of building a data warehouse, guided by our adept Data Architect. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-warehouse , #business-intelligence , #databases , #cloud-storage , #etl , #olap , #database-management , #relational-database , and more. This story was written by: @ishaanraj . Learn more about this writer by checking @ishaanraj's about page, and for more stories, please visit hackernoon.com . A data warehouse, optimized for OLAP (Online Analytical Processing), is a centralized repository for structured and processed data. Unlike traditional OLTP (Online Transaction Processing) systems, it's designed for efficient querying and reporting. The use of columnar storage in data warehouses allows for quicker data retrieval, especially beneficial for analytical queries.…

Data Science Tech Brief By HackerNoon

1
Advancing Data Quality: Exploring Data Contracts with Lyft 15:39

לפני 2 years15:39

15:39

This story was originally published on HackerNoon at: https://hackernoon.com/advancing-data-quality-exploring-data-contracts-with-lyft . Keen to delve into data contracts and discover how they can enhance your data quality? Join me as we explore Lyft's Verity data contract approach together! Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-quality , #data-rel , #data-engineering , #data , #lyf , #data-observability , #verity-review , #hackernoon-top-story , #hackernoon-es , #hackernoon-hi , #hackernoon-zh , #hackernoon-fr , #hackernoon-bn , #hackernoon-ru , #hackernoon-vi , #hackernoon-pt , #hackernoon-ja , #hackernoon-de , #hackernoon-ko , #hackernoon-tr , and more. This story was written by: @bmarquie . Learn more about this writer by checking @bmarquie's about page, and for more stories, please visit hackernoon.com . In a previous post, I explored Airbnb’s strategy for enhancing data quality through incentives. Lyft is taking a distinct approach, not attempting the same thing differently, but rather focusing on different aspects of data quality. Lyft places emphasis on actively testing and validating data quality, providing both producers and consumers with the means to effectively improve and control the quality.…

Data Science Tech Brief By HackerNoon

1
Building a CI Pipeline with Databricks dbx Tool and GitLab 12:33

לפני 2 years12:33

12:33

This story was originally published on HackerNoon at: https://hackernoon.com/building-a-ci-pipeline-with-databricks-dbx-tool-and-gitlab . Explore streamlined CI/CD in Databricks with Asset Bundles. Simplify deployment, eliminate complexities, and enhance workflow efficiency Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #databricks , #mlops , #ci-cd-pipelines , #gitlab-ci , #devops , #dbx , #databricks-assets , #devops-guide , and more. This story was written by: @neshom . Learn more about this writer by checking @neshom's about page, and for more stories, please visit hackernoon.com . discover how to implement a robust CI/CD pipeline using Databricks DBX and GitLab. Tailored for data engineering and science, this guide unravels CI/CD fundamentals, Databricks integration, and the pivotal role of Databricks CLI Extension (DBX). The hands-on example showcases the seamless deployment of a Databricks workflow, automating data manipulation, analysis, and testing. As we bridge CI/CD principles with Databricks workflows, you'll gain practical insights into enhancing data project efficiency and reliability. This blog serves as a comprehensive resource for those seeking to optimize their data processing workflows through the integration of cutting-edge CI/CD practices with Databricks capabilities.…

Data Science Tech Brief By HackerNoon

1
Meeting Customer Needs With User-Centric Product Development 8:36

לפני 2 years8:36

8:36

This story was originally published on HackerNoon at: https://hackernoon.com/meeting-customer-needs-with-user-centric-product-development . In a nutshell, user-centric product development implies attentiveness to the client's needs. This approach puts the customer at the heart of the product Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #customer-experience , #user-centric-designing , #product-development , #product-design , #product-management , #user-centric-design , #customer-engagement , #customer-needs , and more. This story was written by: @tonythevoit . Learn more about this writer by checking @tonythevoit's about page, and for more stories, please visit hackernoon.com . Today, it has become difficult to compete with other solutions on the market if your product or service does not meet the user's expectations. Markets have become more saturated, and users now lean toward products that solve their problems and that are friendly and easy to navigate. Businesses that have adopted a user-centric approach are finding greater success through increased customer satisfaction and loyalty. Importantly, users who feel valued and heard are more likely to become loyal to the product and actively promote it.…

Data Science Tech Brief By HackerNoon

1
Is Your Data Worth the Costs? 20:29

לפני 2 years20:29

20:29

This story was originally published on HackerNoon at: https://hackernoon.com/is-your-data-worth-the-costs . Data, when used strategically, can be a powerful tool for businesses to achieve their goals. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data , #data-driven , #data-hoarding , #kpis , #data-strategy , #data-governance , #user-experience , #what-is-product-value , and more. This story was written by: @liorb . Learn more about this writer by checking @liorb's about page, and for more stories, please visit hackernoon.com . Data, when used strategically, can be a powerful tool for businesses to achieve their goals. However, it is important to approach data with a clear plan and to avoid the hidden costs of data hoarding. By prioritizing relevant data, evaluating its impact on business outcomes, and continuously refining data-driven strategies, businesses can unlock the true potential of data to drive growth, improve efficiency, and achieve sustainable success.…

Data Science Tech Brief By HackerNoon

1
How to Modify the Number of Rows Fetched by SAP BusinessObjects Report 1:31

לפני 2 years1:31

1:31

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-modify-the-number-of-rows-fetched-by-sap-businessobjects-report . If your BO Report exceeds the 5000 rows, you may miss out on critical data or insights. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #business-intelligence , #sap-erp , #data-analysis , #data-analytics , #data-analyst , #sap-businessobjects-report , #rows-fetched-in-sap , #sap-business-objects , and more. This story was written by: @luca1iu . Learn more about this writer by checking @luca1iu's about page, and for more stories, please visit hackernoon.com . If your BO Report exceeds the 5000 rows, you may miss out on critical data or insights.…

Data Science Tech Brief By HackerNoon

1
How to Fetch SAP Business Objects Universes Using Python 2:52

לפני 2 years2:52

2:52

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-fetch-sap-business-objects-universes-using-python . With the RESTful API, developers can perform operations like fetching information about reports, universes, folders, scheduling, and other BI-related entities. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #business-intelligence , #data-analyst , #python , #rest-api , #sap , #sap-business-objects , #data-analysis , #businessobjects-restful , and more. This story was written by: @luca1iu . Learn more about this writer by checking @luca1iu's about page, and for more stories, please visit hackernoon.com . With the RESTful API, developers can perform operations like fetching information about reports, universes, folders, scheduling, and other BI-related entities.…

Data Science Tech Brief By HackerNoon

1
59 Stories To Learn About Tensorflow 17:12

לפני 2 years17:12

17:12

This story was originally published on HackerNoon at: https://hackernoon.com/59-stories-to-learn-about-tensorflow . Learn everything you need to know about Tensorflow via these 59 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #tensorflow , #learn , #learn-tensorflow , #machine-learning , #artificial-intelligence , #python , #deep-learning , #latest-tech-stories , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
How to Specify Data Format in Excel with Python 3:03

לפני 2 years3:03

3:03

This story was originally published on HackerNoon at: https://hackernoon.com/how-to-specify-data-format-in-excel-with-python . Learn the art of efficient data management with Python's xlsxwriter. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #python-programming , #data-analysis , #python-for-excel , #xlswriter , #business-intelligence , #python-tutorial , #python-for-data-analysis , #use-xlsxwriter-to-save-excel , and more. This story was written by: @luca1iu . Learn more about this writer by checking @luca1iu's about page, and for more stories, please visit hackernoon.com . This tutorial showcases the power of Python's xlsxwriter in saving and stylizing Excel sheets. From handling multiple data frames to formatting data types accurately, this step-by-step guide empowers you to master Excel with Python, enhancing your data management capabilities.…

Data Science Tech Brief By HackerNoon

1
322 Stories To Learn About Python Programming 1:12:00

לפני 2 years1:12:00

1:12:00

This story was originally published on HackerNoon at: https://hackernoon.com/322-stories-to-learn-about-python-programming . Learn everything you need to know about Python Programming via these 322 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #python-programming , #learn , #learn-python-programming , #python , #python-tutorials , #programming , #web-monetization , #learn-python , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
75 Stories To Learn About Datasets 19:35

לפני 2 years19:35

19:35

This story was originally published on HackerNoon at: https://hackernoon.com/75-stories-to-learn-about-datasets . Learn everything you need to know about Datasets via these 75 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #datasets , #learn , #learn-datasets , #machine-learning , #data-science , #artificial-intelligence , #data , #ai , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
143 Stories To Learn About Data Visualization 34:52

לפני 2 years34:52

34:52

This story was originally published on HackerNoon at: https://hackernoon.com/143-stories-to-learn-about-data-visualization . Learn everything you need to know about Data Visualization via these 143 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-visualization , #learn , #learn-data-visualization , #data-science , #data-analysis , #data , #data-analytics , #javascript , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
53 Stories To Learn About Data Scraping 16:07

לפני 2 years16:07

16:07

This story was originally published on HackerNoon at: https://hackernoon.com/53-stories-to-learn-about-data-scraping . Learn everything you need to know about Data Scraping via these 53 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-scraping , #learn , #learn-data-scraping , #web-scraping , #python , #data-science , #data , #python-tutorials , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
49 Stories To Learn About Data Storage 12:27

לפני 2 years12:27

12:27

This story was originally published on HackerNoon at: https://hackernoon.com/49-stories-to-learn-about-data-storage . Learn everything you need to know about Data Storage via these 49 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-storage , #learn , #learn-data-storage , #data , #storage , #cloud-storage , #web-monetization , #decentralized-internet , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
229 Stories To Learn About Data Analytics 54:42

לפני 2 years54:42

54:42

This story was originally published on HackerNoon at: https://hackernoon.com/229-stories-to-learn-about-data-analytics . Learn everything you need to know about Data Analytics via these 229 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analytics , #learn , #learn-data-analytics , #data-science , #data , #data-analysis , #big-data , #machine-learning , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
537 Stories To Learn About Data Science 2:28:43

לפני 2 years2:28:43

2:28:43

This story was originally published on HackerNoon at: https://hackernoon.com/537-stories-to-learn-about-data-science . Learn everything you need to know about Data Science via these 537 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #learn , #learn-data-science , #machine-learning , #artificial-intelligence , #python , #ai , #web-monetization , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
253 Stories To Learn About Data Analysis 1:03:46

לפני 2 years1:03:46

1:03:46

This story was originally published on HackerNoon at: https://hackernoon.com/253-stories-to-learn-about-data-analysis . Learn everything you need to know about Data Analysis via these 253 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-analysis , #learn , #learn-data-analysis , #data-science , #data , #data-analytics , #big-data , #data-visualization , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
693 Stories To Learn About Data 2:54:55

לפני 2 years2:54:55

2:54:55

This story was originally published on HackerNoon at: https://hackernoon.com/693-stories-to-learn-about-data . Learn everything you need to know about Data via these 693 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data , #learn , #learn-data , #data-science , #big-data , #data-analysis , #machine-learning , #data-analytics , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
361 Stories To Learn About Big Data 1:36:18

לפני 2 years1:36:18

1:36:18

This story was originally published on HackerNoon at: https://hackernoon.com/361-stories-to-learn-about-big-data . Learn everything you need to know about Big Data via these 361 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #big-data , #learn , #learn-big-data , #data-science , #data , #machine-learning , #artificial-intelligence , #data-analysis , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
188 Stories To Learn About Analytics 52:46

לפני 2 years52:46

52:46

This story was originally published on HackerNoon at: https://hackernoon.com/188-stories-to-learn-about-analytics . Learn everything you need to know about Analytics via these 188 free HackerNoon stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #analytics , #learn , #learn-analytics , #data-science , #data , #data-analytics , #data-analysis , #machine-learning , and more. This story was written by: @learn . Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com .…

Data Science Tech Brief By HackerNoon

1
Empathy in Data: Unveiling the Human Stories Behind UX Research 8:07

לפני 2 years8:07

8:07

This story was originally published on HackerNoon at: https://hackernoon.com/empathy-in-data-unveiling-the-human-stories-behind-ux-research . Over the years, friends often inquire about my field research experiences, so I've decided to share two small stories. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data-science , #empathy-in-data , #human-element-in-ux-research , #ux-research , #ux-ui-research , #love-after-trauma , #daily-data-analysis , #ux-researchers , and more. This story was written by: @unknownsong . Learn more about this writer by checking @unknownsong's about page, and for more stories, please visit hackernoon.com . Over the years, friends often inquire about my field research experiences, so I've decided to share two small stories.…

Data Science Tech Brief By HackerNoon

1
Conquering Data Hoarding: Unleashing the True Potential of Data for Organizations 9:30

לפני 2 years9:30

9:30

This story was originally published on HackerNoon at: https://hackernoon.com/conquering-data-hoarding-unleashing-the-true-potential-of-data-for-organizations . Data hoarding is stifling innovation. Unlock data's true potential by implementing data governance, enhancing data quality, and optimizing data access. Check more stories related to data-science at: https://hackernoon.com/c/data-science . You can also check exclusive content about #data , #data-driven-decision-making , #data-hoarding , #data-misuse , #data-roi , #data-driven-organization , #data-quality , #data-access , and more. This story was written by: @liorb . Learn more about this writer by checking @liorb's about page, and for more stories, please visit hackernoon.com . Data hoarding is a common problem for organizations, hindering their ability to derive valuable insights and drive innovation. This article delves into the challenges of data hoarding and provides actionable strategies to overcome them, empowering organizations to tap into the true potential of their data assets.…

ברוכים הבאים אל Player FM!

Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.