Big Data For News Publishers

Big Data For News Publishers RSS

Big Data For News Publishers

Database design: What to get, what to keep, what to shed

02 February 2016 · By Greg Bright

Last month I talked about the half-life of data – how time not only degrades but can destroy value if not governed carefully. For example, a stop for non-pay followed by a restart then a stop for a move-out-of-area; they all loose relevance when you get a next new next start at the same address. 

Assuming the new start is a different name and/or phone number, the value of the previous transaction history for much (if not all) of your standard analysis is destroyed. If not filtered carefully, it can lead you to erroneous conclusions.

Why? A different person is now at the address. You need to track his/her activity separately.

Not all data is useable. So news media companies should be picky and proactive.

This month, I’ll weave through some of the considerations you need to ...


Does data have a “use by” shelf life? Not if your data scientists are doing their jobs

05 January 2016 · By Greg Bright

There is a rule of thumb in the data world that you should save everything. Every stop, every vacation, every payment. If you can think of it, save it. You might need it. Storage is cheap. Save it all. 

Well, sure, you can save it. But does data collected ever reach a point where it is too old to use? Is it possible that old data may be leading you to a flawed analytical conclusion? Is old data setting the stage for errors and waste in your marketing campaigns?

Or, is having ancient information enabling you to discover key insights that would never be possible without the information extracted from the history files?

The answers to the above questions, without a highly refined data governance and usage policy in place, are all: “It depends.” For each situation it is critical to know the context of the use planned for the old data.

Let’s take a quick look at a simple example – a telephone number. The phone number in question is from a customer who last received your publication (or site access) three years ago. Is there value in having this phone number? Should you dial it in a telemarketing campaign?

Well, it depends. You have to look at how the customer associated with the phone number left you. Did the customer leave you with a transaction indicating a move from market? Or did he leave you with ...


How to choose a vendor for your Big Data needs

01 December 2015 · By Greg Bright

Oh, this post will be fun.

My hunch is that, from the time I write this to the time you read this, one of the vendors will be no more and three new ones will have sprung up. This is the unfortunate reality of the ecosystem of Big Data.

Hadoop, NoSQL, and all of the others living in the cloud storage/tools world are in an explosive stage of development, with many new companies jumping into the fray with a widget that makes something possible (time series) or the large firms making something easier to do (drag and drop H-SQL).

All of this inventive effort makes selecting the right set of tools to build your technology stack very difficult. The classic cliché of 20:20 hindsight will prove yet again that your great tech decision was wrong. But, you can’t stand on the sidelines; you have to pick something.

So, if you are sure you and your company are ready for the Big Data stack (versus lots of data), let’s jump down the rabbit hole ...


List management: Test and control groups for picking a winning campaign

18 November 2015 · By Greg Bright

You would think this topic would be pretty simple. At 50,000 feet it is: Split the e-mail list into two halves and call it a day.

In the weeds of implementation, it is a whole different world. How big should the test group be: 50%, 20%, or something else? Should you test in an A/B mode or multi-variate? How much (or little) should you change between the A and B designs?

Should the design look somewhat similar, or is a radical variation ok? What criteria do you use to decide how to split the list into groups? How do you vary the pieces: Is one a true control, or do you just constantly try variations?

In e-mail campaigns, can you use opens/click thrus to dynamically pick the winner mid-campaign? How do you measure direct mail? Are there other campaigns happening at the same time to the same groups (telemarketing, for example)?

So much for simple.

Then when the campaign completes, if the test group sells 50 units, and the control group 43 units, the winner is easy to pick, right? Or is it?

To split or not to split

The short answer: Split every campaign related to sales and retention efforts. Every campaign is a chance to test and improve. People are fickle and will respond differently to ...


How to tell if your news media company really has Big Data

28 September 2015 · By Greg Bright

This is a continuation of my previous post, which began exploring the difference between Big Data and lots of data.

Another way to approach the Big Data technology decision is to start with looking at your data and categorising it into what is and what is not Big Data.

It is not Big Data, in my opinion, if you are looking at customer account history, digital subscription access log summary data (device, OS version, user information), or payment history.

Nor is it predictive analytics; predictive analytics is a process applied to data (big or not), not the data in and of itself.

Likewise, if you are sitting on less than a dozen terabytes of data and it is growing at less than 20% a year and you are just running reports to understand what happened with your product, you don’t have Big Data (nor do you have a Big Data technology need).

You have lots of data, but not the kind of data or application need from the analytical discoveries that make the Big Data technologies ...


Big Data or just lots of data? The hype, the hope, the reality

23 September 2015 · By Greg Bright

It seems like every day I get a letter from a company telling me that I’ve got to get a “Big Data solution” installed or my company will fail. I also get “real world of Hadoop” e-mails – usually links to white papers on why everyone is adopting Hadoop and NoSQL solutions to solve their problems.

The phone calls come as well. Usually the calls are from big name IT firms. They invariably have the same message: They have a solution and consultants that will solve all of my problems by installing a Big Data solution. 

I tend to like to play with the callers a bit, first to stay up with the latest technology, and secondly to see if the callers really understand my company or if it is just a cold call script.

I say something like: “What problems? Do you even know my business?” They usually don’t have a clue about my company, making their replies sound like the reading of a script loaded into their ...


3 rules, 15 mistakes, and other tips for successful direct marketing campaigns

27 August 2015 · By Greg Bright

Mistakes happen. The goal with training, checks and balances, and defined procedures is to prevent as many as possible – hopefully all of them.

However, some things inevitably are not thought of, appear out of nowhere, and catch even the best organisation off guard.

To keep mistakes to a minimum, when helping companies launch direct marketing efforts, I give them a list of the top 10 things that will go wrong in hopes that they can avoid everything on the list. I’ve come to realise that many of the mistakes seem to be unavoidable, and each client will make them regardless of any advance warning.

The inside joke is that there are now more than 25 things on my top-10 list.

Between problems with dirty data coming in, mistakes in selections, broken software, or even problems with the type of ink in a printer, mistakes happen. And they result in everything from having a good chuckle (the AMEX logo next to the VISA check box) to a major financial issue (the entire 80,000-piece mailing sent to the newspaper’s office instead of the prospect’s because ...


5 keys to monitoring marketing campaign response rates

05 August 2015 · By Greg Bright

So did it work?

You’ve spent several weeks designing a marketing campaign. From designing the piece, setting up special rate codes, promotion codes, building a consistent cross-channel message, and scripting to the building out a highly refined selection criteria to select the lists used for the campaign.

Out into the mail the piece goes. Up go the run of site ads. The e-mails are sent and, finally, the telemarketing follow-up takes place. Three weeks later you send a second e-mail, then finally the campaign wraps up and the promotions on the Web site return to the standard copy. 

Did it work? Which channel performed, which didn’t? What was the cost? 

Monitoring response by various key indicators is critical. Having the monitors in place right from the very beginning is critical.

If you are a typical media operation, you probably have the next campaign set to launch right away. You are probably seeing questions from the executives in the organisation wondering about the campaign.

If it went right, can you do it again. And if it went poorly, what you (and the rest of the campaign design group) doing to on the expense side to ...


Sustainable response rates in acquisition campaigns rely on refreshed data

12 July 2015 · By Greg Bright

My favourite words from the sales management after a campaign executes is “Do it again.”

It is always reassuring to hear that all of the work involved in producing a well-designed acquisition campaign brought in the results expected. The modeling worked, the selections worked, the size of the list was right, the data was well paired with the creative and offers presented to the recipients. Success!

And, my most feared words from sales management? “Do it again.”

What? Can the same statement be both loved and feared? Yes.

From the data perspective, it is impossible to “do it again.” The data has changed from the initial campaign run 60 days ago to today’s running. Those addresses that made the first run a success are now customers so they aren’t available in the next pass. A literal running “again” just picks all of the non-responders from the first pass.

Sure, some will respond, but nowhere near the first attempt. So, doing it again won’t make anyone ...


Why volume-based campaigns are a flawed audience-building model

15 June 2015 · By Greg Bright

In the age of Big Data, news media companies are operating with an unprecedented amount of information on which to base critical business decisions. The ability to append demographics and lifestyle data and transactional history, unify online and offline data to achieve a “single customer view,” and create advanced segmentation models at an individual customer level are all very exciting. 

But in the end, we are still confronted with the challenge of aligning supply with demand to justify our marketing investments and effectively measure the return on those investments.

As marketers we have all asked or been asked the question: “Can’t you get me more customers?”

In other cases, it comes in the form of the statement “I need X new customers this month.”

Both are best addressed through very careful analytics and application of micro-economic theory.

Volume-based planning: a flawed model

A common mistake of marketers is to follow the simple, traditional, volume-driven approach (i.e. “I need X new customers this month”). In the campaign design, we skip the supply and demand consideration and jump to the conclusion – not because we did the math but because ...


About this blog

The aim of the Big Data For News Publishers blog is to provide thought leadership to turn data-oil into a gold mine of opportunities. The blog will highlight case studies of how Big Data is used to bring more editorial relevancy, better audience engagement, and more value to advertising clients.

Meet the bloggers

Greg Bright
Chief Data Officer and Principal Architect
LEAP Media Solutions
Old Saybrook, Connecticut, USA
send message



Blog archives

February 2016 ( 1 )
January 2016 ( 1 )
December 2015 ( 1 )
November 2015 ( 1 )
September 2015 ( 2 )
August 2015 ( 2 )
July 2015 ( 1 )
June 2015 ( 1 )
May 2015 ( 1 )
February 2015 ( 1 )
December 2014 ( 1 )
October 2014 ( 1 )
September 2014 ( 1 )
August 2014 ( 2 )
July 2014 ( 1 )
June 2014 ( 1 )
May 2014 ( 1 )
April 2014 ( 2 )
March 2014 ( 1 )
February 2014 ( 1 )

Join INMA Today
Upcoming Events
INMA Mobile Strategies Conference
Seattle (Redmond), United States
10-11 March 2016
INMA Ideas Day on Advertising
Frankfurt, Germany
11 March 2016
Big Data for Media Week
New York, United States
11-15 April 2016
Media Disruption and Legacy Media Reinvention Study Tours
London, United Kingdom
19-20 May 2016
INMA World Congress
London, United Kingdom
22-24 May 2016
INMA Ideas Day on Audience Development
Amsterdam, The Netherlands
17 June 2016
INMA International News Media Conference
São Paulo, Brazil
23-24 August 2016

More Events

Member Profiles

  • Axeu Aislan Beluca

  • Priscilla Pineda Hernandez

  • Federico Niethardt

  • Harry Gerd

  • Mark Kurtich
    United States

  • Chelsea Wymer

©2016 INMA | Home | About | Contact | RSS | Privacy