<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[data mining - ]]></title><description><![CDATA[data mining - ]]></description><link>http://carltonmatthews.com/</link><generator>Ghost 0.5</generator><lastBuildDate>Wed, 22 Apr 2026 16:33:35 GMT</lastBuildDate><atom:link href="http://carltonmatthews.com/tag/data-mining/rss/" rel="self" type="application/rss+xml"/><ttl>60</ttl><item><title><![CDATA[Data Mining - Customer Marketing]]></title><description><![CDATA[<h2 id="introduction">Introduction</h2>

<p>Then finance and banking industry has gone through massive shifts in the in the last decade.  Between the downturn from the financial crisis in 2008 and the increasingly disruptive pressure from Silicon Valley it is even more important to understand our customers’ behavior. (Deloitte, 2016)  Direct sales marketing is one of the most effective methods for both gaining new customers as well as increasing the deposits of our existing customers.  Globalytics Capital needs to gain better insight into its customer’ behavior to be poised for success in the future. In order to position Globalytics Capital the Data Access Response Team (D.A.R.T) is proposing an analysis be done using the customer marketing database.  </p>

<h2 id="analysismethod">Analysis Method</h2>

<p>As a proof of concept D.A.R.T. has created this report detailing how such an analysis could be conducted using a similar banking database.  The data that D.A.R.T will be utilizing comes from the Center for Machine Learning and contains the result of direct marketing campaigns from another banking institution.  (Moro, Cotez, &amp; Rita, 2014)  Globalytics Captial conducts similar campaigns throughout the year.  A direct marketing campaign consists of phone calls made to potential customers with the positive outcome being a deposit made with the bank.  The data set that we will be looking at contains 17 input attributes and one output attribute.  The input attributes are organized in 3 groups.  </p>

<ol>
<li>Bank Client Data  </li>
<li>Last Contact Data  </li>
<li>Extended Contact Data</li>
</ol>

<h3 id="bankclientdata">Bank Client Data</h3>

<p>This is demographic data about the customer being contacted.  The information captured here helps the marketer better understand the customer’s life circumstances and whether they have existing loans.  The following table details these attributes.</p>

<p><img src="http://carltonmatthews.com/content/images/2016/12/Screen-Shot-2016-12-27-at-4-50-30-PM.png" alt=""></p>

<h3 id="lastcontactdata">Last Contact Data</h3>

<p>This is data about the last contact with the customer during the current campaign.  It is important to know how long it has been between customer contacts.  Too frequent contacts can result in negative outcomes with customers so marketers need to know this information.  </p>

<p><img src="http://carltonmatthews.com/content/images/2016/12/Screen-Shot-2016-12-27-at-4-51-21-PM.png" alt=""></p>

<p>Extended Contact Data <br>
This data gives us additional information about the current campaign as well as the previous marketing campaign.  This is important to understand how this customer has responded in the past.</p>

<p><img src="http://carltonmatthews.com/content/images/2016/12/Screen-Shot-2016-12-27-at-4-51-59-PM.png" alt=""></p>

<p>Finally, there is the output variable labeled y which shows whether the call was successful.</p>

<h3 id="dataminingapproach">Data Mining Approach</h3>

<p>For this example, the apriori algorithm will be used to determine the which customers will be most likely to make a deposit during a marketing campaign.  This will allow us to prioritize the customers during the campaign.  Several of the fields within this data set will need to be modified before any processing can being.  Six of the fields will need to be changed from continuous numeric fields into discrete bins.  Specifically, the age, balance, duration, campaign, pdays, and previous fields need to be modified.  This allows us to count the number of rows.  The below chart shows the age range pins.</p>

<p><img src="http://carltonmatthews.com/content/images/2016/12/bars-age.png" alt=""></p>

<h3 id="interpretation">Interpretation</h3>

<p>Within the data set there were a total of 4521 calls made during this campaign.  521 calls were successful while 4000 were not successful resulting in a 11% success rate for this campaign.  This again shows the importance for knowing which customers to target.  </p>

<p><img src="http://carltonmatthews.com/content/images/2016/12/deposit-made-pie.png" alt=""></p>

<p>After interpreting the data, it was determined that there were only 2 conditions that have an impact on the outcome of a solicitation call.  Customers with no personal loans and nothing in default are the most likely to respond favorably.  For both of these conditions the algorithm returned with around 12% confidence.  This is not a high level of confidence however this is in line with the 11% success rate for the campaign.  </p>

<h3 id="conclusions">Conclusions</h3>

<p>Moving forward the team feels that we should adjust the bins for some of the continuous fields.  This would allow for rule sets with a higher support and confidence levels.  The data set was a small sample of the data that would be available from Globalytics Capital.  With a larger data set there would be a greater opportunity for building association rules.</p>

<h3 id="references">References</h3>

<ul>
<li>Deloitte. (2016, July 1). Banking Industry Outlook: Banking reimagined. Retrieved Oct 17, 2016, from Deloitte: <a href="http://www2.deloitte.com/us/en/pages/financial-services/articles/banking-industry-outlook.html">http://www2.deloitte.com/us/en/pages/financial-services/articles/banking-industry-outlook.html</a></li>
<li>Moro, S., Cotez, P., &amp; Rita, P. (2014, June 1). Bank Marketing Data Set. Retrieved from Machine Learning Repository: <a href="https://archive.ics.uci.edu/ml/datasets/Bank+Marketing">https://archive.ics.uci.edu/ml/datasets/Bank+Marketing</a></li>
</ul>

<h3 id="apendixarcode">Apendix A – R Code</h3>

<p><code>library(arules)
library(arulesViz) <br>
setwd("~/Documents/DATA 630 FALL 2016/Assignment 3/bank")</code></p>

<p><code>bank &lt;- read.csv("~/Documents/DATA 630 FALL 2016/Exercise 3/Bank.csv")
str(bank)</code></p>

<p><code>bank$age &lt;- discretize(bank$age, "frequency", categories=6)
bank$balance &lt;- discretize(bank$balance, "frequency", categories=6) <br>
bank$duration &lt;- discretize(bank$duration, "frequency", categories=6) <br>
bank$campaign &lt;- discretize(bank$campaign, "frequency", categories=6) <br>
bank$pdays &lt;- discretize(bank$pdays, "frequency", categories=6) <br>
bank$previous &lt;- discretize(bank$previous, "frequency", categories=6)</code></p>

<p><code>rules&lt;-apriori(bank, parameter=list(supp=0.1, conf=0.1, minlen=2), appearance=list(rhs=c("y=yes"), default="lhs"))</code></p>

<p><code>rules.sorted &lt;- sort(rules, by="lift")</code></p>

<p><code>subset.matrix &lt;- is.subset(rules.sorted, rules.sorted)
subset.matrix[lower.tri(subset.matrix, diag=T)] &lt;- NA <br>
redundant &lt;- colSums(subset.matrix, na.rm=T) &gt;= 1 <br>
rules.pruned &lt;- rules.sorted[!redundant]</code></p>

<p><code>plot(bank$age, col=rainbow(6), xlab="Age Range", ylab="Number of Customers", main="Count per Age Range")</code></p>

<p><code>lbls &lt;- paste(names(table(bank$y)), "\n", table(bank$y), sep="")
pie(table(bank$y), col=rainbow(4), main="Deposit Made", labels=lbls)</code></p>]]></description><link>http://carltonmatthews.com/data-mining-customer-marketing/</link><guid isPermaLink="false">d01323e8-7119-424e-9ed5-cadbbcc8c154</guid><category><![CDATA[data mining]]></category><category><![CDATA[Fall2016]]></category><dc:creator><![CDATA[Carlton Matthews]]></dc:creator><pubDate>Thu, 29 Dec 2016 18:10:29 GMT</pubDate></item><item><title><![CDATA[Data Mining Exercise 1]]></title><description><![CDATA[<p>Continuing in the <a href="http://carltonmatthews.com/tag/show_your_work/">#ShowYourWork</a> effort as I move into my summer semester class on Data Mining.  Here are the questions that I had to answer for this week.</p>

<hr>

<h3 id="summarizewhatdataminingtoolscanrevealabouttheirisdata">Summarize what data mining tools can reveal about the Iris data.</h3>

<p>Data mining tools can help to identify patterns and trends within the Iris data set.  These types of tools can also facilitate statistical analysis of the data.  Tools like R can be used to explore that data and gather descriptive statistics on the data such as record count, mean, and percentiles.  Through this identification of patterns machine learning models can be built and trained.  The Iris dataset was used during the recent Google Developers series on Machine Learning. <em><a href="https://www.youtube.com/playlist?list=PLKX8hZ1Cat4P2cG_ha40e803oOl4aM7MK">(Gordon, 2016)</a></em> </p>

<h3 id="whyisitimportantforthedataminingtooltohavevisualizationcapabilities">Why is it important for the data-mining tool to have visualization capabilities?</h3>

<p>Data visualization is the process of showing information in a tabular or graphical way. <em><a href="http://amzn.to/1TQwJk2">(Tan, Steinbach, &amp; Kumar, 2006)</a></em> While spreadsheets are one way of visualizing data it is often more useful for an audience to see data represented in a graphical way.  Charts and graphs can be used to visualize patterns in the Iris dataset.  One of the reasons that a tool like R is powerful are the built-in visualizations.  Instead of having to transpose data from one tool into another you can build pie charts, histograms, and scatter plot graphs directly in the tool.  This eliminates the data entry errors that can occur across tools.</p>

<h3 id="isanopensourcedataminingtoolbetterthanacommercialonewhyorwhynot">Is an open source data mining tool better than a commercial one?  Why or why not?</h3>

<p>Over the course of my career I have worked with both open source and commercial software tools.  Open source software described software whose source code is available for free redistribution and can be modified by anyone. <em><a href="https://opensource.org/osd">(Open Source Initiative, 2007)</a></em>  Using open source software and tools typical has a lower cost of ownership that commercial tools.  These types of tools often include a community of users who volunteer best practices and feature upgrades.  This can give an organization greater flexibility over the control of their tools.  The downside to using an open source tool comes in resolving bugs when an open source tool is abandoned.  Since these types are tools are supported by volunteers many projects are abandoned with no avenue for getting fixes.  On the other hand, commercial tools typically have dedicated support infrastructures.  Enterprise customers purchases legally binding service level agreements(SLAs) that promise both timely support and upgrades.  With the support systems behind them commercial tools have much higher cost of ownership for an organization.  As a systems engineer for the federal government we use a combination of both commercial and open source software and tools.  I encourage my clients to decide on which to use on a case by case basis.  For the benefit of this question I would recommend using open source tools initially.  The low cost of ownership and flexibility allows you to learn.  Once the project has matured or needs a greater level of support than it is time to examine moving to a commercial tool.</p>

<h3 id="references">References</h3>

<p>Gordon, J. (2016, March 30). {ML} Machine Learning Recipies. Retrieved May 19, 2016, from Youtube: <a href="https://www.youtube.com/playlist?list=PLKX8hZ1Cat4P2cG_ha40e803oOl4aM7MK">https://www.youtube.com/playlist?list=PLKX8hZ1Cat4P2cG_ha40e803oOl4aM7MK</a> <br>
Open Source Initiative. (2007, March 22). The Open Source Definition. Retrieved May 19, 2016, from Open Source Initiative: <a href="https://opensource.org/osd">https://opensource.org/osd</a> <br>
Tan, P.-N., Steinbach, M., &amp; Kumar, V. (2006). Introduction to Data Mining (Vol. 3). Boston, MA, USA: Pearson Education, Inc.</p>]]></description><link>http://carltonmatthews.com/data-mining-exercise-1/</link><guid isPermaLink="false">e379540e-3298-4bc0-ab9f-da0974430a59</guid><category><![CDATA[show_your_work]]></category><category><![CDATA[data mining]]></category><category><![CDATA[R]]></category><dc:creator><![CDATA[Carlton Matthews]]></dc:creator><pubDate>Mon, 23 May 2016 01:33:54 GMT</pubDate></item></channel></rss>